esd  aMionIisi  

DRI  Call  No.4^3;^ 

INTElll^lBldlY-ESXSDRMANCE  OF  NARROWBAND  LINEAR 
^3  PREDICTIVE  VOCODERS  IN  THE  PRESENCE  OF  BIT  ERRORS 

f ^ 


Caldwell  P.  Smith 

Voice  Processing  Laboratory 

COMSEC  Engineering  Office 


November  (977 


Approved  for  Pubdc  Release; 
Distribution  Unlimited. 


Prepared  for 

DEPUTY  FOR  COMMAND  AND  MANAGEMENT  SYSTEMS 
ELECTRONIC  SYSTEMS  DIVISION 
HANSCOM  AIR  FORCE  BASE,  MA  0I73I 


ADA0SI513 


LEGAL  NOTICE 

When  U.  S.  Government  drawings,  specifications  or  other  data  are  used  for  any 
purpose  other  than  a definitely  related  government  procurement  operation,  the 
government  thereby  Incurs  no  responsibility  nor  any  obligation  whatsoever;  and 
the  fact  that  the  government  may  have  formulated,  furnished,  or  In  any  way  sup- 
plied the  said  drawings,  specifications,  or  other  data  is  not  to  be  regarded  by 
implication  or  otherwise  as  in  any  manner  licensing  the  holder  or  any  other  person 
or  conveying  any  rights  or  permission  to  manufacture,  use,  or  sell  ony  patented 
invention  that  may  in  any  way  be  related  thereto. 


OTHER  NOTICES 


Do  not  return  this  copy.  Retain  or  destroy. 


"This  technical  report  has  been  reviewed  and  is  approved  for 
publ ication. " 


'/oi. 


STEVE  MEISTER,  Captain, 
Project  Engineer 


USAF 


J.  P.  VETRANO,  Director 

COMSEC  Engineering  Office 

Deputy  for  Command  and  Management  Systems 


UNCLASSIFIED 


security  classification  of  this  page  flWion  D«<»  Entered) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

1.  REPORT  NUMBER  2.  GOVT  ACCESSION  NO. 

ESD-TR-77-328 

3.  RECIPIENT'S  CATALOG  NUMBER 

4.  TITLE  fand  Subfif/eJ 

INTELLIGIBILITY  PERFORMANCE  OF 

NARROWBAND  LINEAR  PREDICTIVE  VOCODERS 

IN  THE  PRESENCE  OF  BIT  ERRORS 

5.  TYPE  OF  REPORT  & PERIOD  COVERED 

Interim  Report 

March  1977  - November  1977 

6.  PERFORMING  ORG.  REPORT  NUMBER 

7.  author^*; 

CALDWELL  P.  SMITH 

8.  CONTRACT  OR  GRANT  NUMBERCsJ 

IN-HOUSE 

9.  PERFORMING  ORGANIZATjON  NAME  AND  ADDRESS 

Voice  Processing  Laboratory 

COMSEC  Engineering  Office 

Electronic  Systems  Division,  Honscom  AFB,  MA  01731 

10.  PROGRAM  ELEMENT,  PROJECT.  TASK 
AREA  & WORK  UNIT  NUMBERS 

3340IF 

Project  7820  Task  0^01 

11.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

Deputy  for  Command  and  Management  Systems 

Electronic  Systems  Division,  Honscom  AFB,  MA  01731 

12.  REPORT  DATE 

NOVEMBER  1977 

13.  NUMBER  OF  PAGES 

14.  MONITORING  AGENCY  NAME  & ADDRESS^i/ d///erenf  from  ControiUng  0//tce; 

IS.  SECURITY  CLASS,  (ol  thie  report) 

UNCLASSIFIED 

iSo.  DECLASSIFICATION/ DOWN  GRADING 

SCHEDULE 

nZa 

16.  DISTRIBUTION  STATEMENT  ro/ 

Approved  for  Public  Release;  Distribution  Unlimited. 

17.  DISTRIBUTION  STATEMENT  (o(  the  ebetrect  entered  in  Block  20,  li  different  from  Report) 

18.  supplementary  NOTES 

19.  KEY  WORDS  (Continue  on  revoreo  aide  if  neceeaery  and  idonf//y  by  block  number) 

Voice  Communication  DRT 

Speech  Intelligibility  Vocoders 

Test  and  Evaluation  Linear  Prediction  Coding 

Diagnostic  Rhyme  Test  LPC 

Narrowband  Speech  Speech  Processing 

20.  ABSTRACT  (Continue  on  reverae  aide  if  neceaamry  and  /d®nf//y  by  block  nutnber)  i *1  • e » 

Diagnostic  speech  intelligibility  tests  were  evaluated  to  assess  vulnerability  ot  two 
different  2400  bit-per-second  linear  predictive  vocoder  algorithms  to  random  bit  errors 
imposed  on  the  data  stream.  Listening  tests  with  crews  of  eight  subjects  yielded 
diagnostic  intelligibility  scores  at  zero,  1%,  3%,  and  5%  bit  error  rates.  These  data 
were  analyzed  to  establish  linear  regression  models  relating  intelligibility  performance 
and  bit  error  rate.  Piecewise-linear  prediction  coding  (PLPC)  was  confirmed  to  have 
a small  but  significant  advantage  through  being  less  vulnerable  to  bit  errors  than 

DD 


I JAN  73 


1473 


EDITION  OF  1 NOV  65  IS  OBSOLETE 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  flWi«n  Dele  Entered) 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PAGErW^en  Data  Entered) 


ABSTRACT  (Con*t) 

conventlonaf  finear  prediction  coding  (LPC),  on  advantage  that  had  been  hypothesized 
from  the  inherent  redundancy  that  is  added  by  transmitting  separate  LPC  coefficients  for 
low-frequency  and  high-frequency  speech  bands,  A small  but  consistent  Improvement  In 
Intelligibility  was  also  found  for  the  error-free  case,  believed  to  result  from  improved 
spectrum  modeling  that  is  a consequence  of  the  piecewise  approach.  Significant 
differences  in  susceptibilities  to  bit  errors  were  found  among  individual  intelligibility 
scores  for  speakers  as  well  as  for  intelligibility  features.  Tables  for  predicting  average 
intelligibility  performance,  and  confidence  limits,  were  constructed  from  the  regression 
models.  The  findings  provide  guidance  for  further  research  towards  the  goal  of  minimizing 
susceptibility  of  narrowband  LPC  vocoders  to  jamming  and  interference.  They  also 
highlight  a need  for  further  studies  to  obtain  better  understanding  of  causes  of  the  typical 
large  dispersion  in  Intelligibility  scores  for  Individual  speakers,  obtained  in  these  and 
many  other  tests.  Such  knowledge  could  contribute  to  improving  voice  processor  designs 
and  to  a goal  of  speech  systems  that  would  provide  fully  adequate  intelligibility  for  95% 
or  99%  of  the  population  of  speakers  using  these  voice  communications  devices. 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PAGErWien  Data  Entered) 


TABLE  OF  CONTENTS 


LIST  OF  ILLUSTRATIONS  vi 

LIST  OF  TABLES  vii 

1 . 0 INTRODUCTION  1 

!.!•  Susceptibility  of  intelligibility  features  to  bit  errors  2 

1.2.  Susceptibility  of  individual  speakers  to  bit  errors  2 

1.3.  Regression  models  relating  speech  intelligibility  scores 

with  bit  error  rate  3 

2.0  TEST  AND  EVALUATION  PROCEDURES  4 

2.1.  Diagnostic  Rhyme  Test  5 

2.2.  Analysis  of  variance  5 

2.3.  Tests  of  normality  and  equality  of  variance  6 

2.4.  Paired  intelligibility  scores  6 

3.0  NARROWBAND  VOICE  PROCESSOR  CONFIGURATIONS  7 

4.0  EFFECTS  OF  BIT  ERRORS  ON  LPC-10  AT  2400  BITS  PER  SECOND  8 

4.1.  Susceptibility  of  scores  for  intelligibility  features 

to  bit  errors:  LPC-IO  at  2400  bits  per  second  11 

4.2.  Susceptibility  of  intelligibility  scores  of  individual 

speakers  to  bit  error  effects:  LPC-10  at  2400  BPS  13 

5.0  EFFECTS  OF  BIT  ERRORS  ON  PLPC  AT  2400  BITS  PER  SECOND  14 

5.1.  Susceptibility  of  scores  for  intelligibility  features 

to  bit  errors:  PLPC  at  2400  bits  per  second.  17 

5.2.  Susceptibility  of  intelligibility  scores  of  individual 
speakers  to  bit  error  effects:  PLPC  at  2400  bits  per  second  19 

6.0  COMPARISONS  OF  PERFORMANCE  OF  LPC  AND  PLPC  OPERATING  AT  2400 

BITS  PER  SECOND  IN  THE  PRESENCE  OF  BIT  ERRORS  20 

6.1.  Analysis  of  variance  findings  20 

6.2.  Pairwise  comparison  of  intelligibility  scores  26 

6.3.  Comparison  of  regression  slopes:  LPC  and  PLPC  total 

intelligibility  vs.  bit  error  rate  28 

6.4.  Comparisons  of  regression  slopes:  intelligibility  feature 

scores  for  LPC  and  PLPC  processors,  vs.  bit  error  rate  29 


i 


7.0  DISCUSSION  OF  FINDINGS 


31 


7.1.  Comparison  of  LPC  and  PLPC  processor  algorithms  32 

7.2.  Implications  for  digital  voice  terminal  hardware 

development  36 

7.3.  Implications  for  intelligibility  test  and  evaluation 

procedures  and  standards  37 

8.0  CONCLUSIONS  AND  RECOMMENDATIONS  39 

BIBLIOGRAPHY  41 

APPENDICES : 

APPENDIX  A.  INTELLIGIBILITY  DATA  FOR  VOICING  FEATURE 

A.l.  DRT  test  words  for  voicing  42 

A. 2.  Data  table:  Voicing  intelligibility  scores  for 

LPC  and  PLPC  processors  43 

A. 3.  Analysis  of  variance  summaries: 

A. 3.1.  Voicing  (Total)  46 

A. 3. 2.  Voicing  present  47 

A. 3. 3.  Voicing  absent  48 


A. 4.  Cumulative  distributions;  DRT  scores  for  voicing 

A. 4.1.  LPC-10  at  2400  BPS  with  bit  errors  49 

A. 4. 2.  PLPC  at  2400  BPS  with  bit  errors  49 

A. 5.  Regression  models  and  scatter  plots:  voicing  scores 
vs.  bit  error  rate 

A. 5.1.  LPC-10  at  2400  BPS  50 

A. 5. 2.  PLPC  at  2400  BPS  50 

A.  6.  Predicted  intelligibility  scores  for  voicing  in 

presence  of  bit  errors 

A.  6.1.  LPC-10  at  2400  BPS  51 

A.  6. 2.  PLPC  at  2400  BPS  51 

APPENDIX  B.  INTELLIGIBILITY  DATA  FOR  NASALITY  FEATURE 

B. l.  DRT  test  words  for  nasality  52 

B.2.  Data  table:  Nasality  intelligibility  scores  for 

LPC  and  PLPC  processors  53 

B.3.  Analysis  of  variance  summaries: 

B. 3.1.  Nasality  (Total)  56 

B.3. 2.  Nasality  present  57 

B.3.3.  Nasality  absent  58 

B.4.  Cumulative  distributions:  DRT  scores  for  nasality 

B.4.1.  LPC-10  at  2400  BPS  with  bit  errors  59 

B.4. 2.  PLPC  at  2400  BPS  with  bit  errors  59 


ii 


B,5,  Regression  models  and  scatter  plots:  nasality  scores 
vs.  bit  error  rate 

B.5.1.  LPC-10  at  2400  BPS  60 

B.5.2.  PLPC  at  2400  BPS  60 

B. 6.  Predicted  intelligibility  scores  for  nasality  in 

presence  of  bit  errors 

B.6.1.  LPC-10  at  2400  BPS  61 

B. 6.2.  PLPC  at  2400  BPS  61 

APPENDIX  C.  INTELLIGIBILITY  DATA  FOR  SUSTENTION  FEATURE 

C. l.  DRT  test  words  for  sustention  62 

C,2.  Data  table:  Sustention  intelligibility  scores  for 

LPC  and  PLPC  processors  63 

C.3.  Analysis  of  variance  summaries: 

C, 3.1,  Sustention  (Total)  66 

C.3.2.  Sustention  (voiced)  67 

C,3.3,  Sustention  (unvoiced)  68 

C.4.  Cumulative  distributions:  DRT  scores  for  sustention 

C.4.1.  LPC-10  at  2400  BPS  with  bit  errors  69 

C.4.2.  PLPC  at  2400  BPS  with  bit  errors  69 

C.5.  Regression  models  and  scatter  plots:  sustention  scores 
vs,  bit  error  rate 

C.5.1.  LPC-10  at  2400  BPS  70 

C.5.2.  PLPC  at  2400  BPS  70 

C. 6.  Predicted  intelligibility  scores  for  sustention  in 

presence  of  bit  errors 

C.6.1.  LPC-10  at  2400  BPS  71 

C. 6.2.  PLPC  at  2400  BPS  71 

APPENDIX  D.  INTELLIGIBILITY  DATA  FOR  SIBILATION  FEATURE 

D. l.  DRT  test  words  for  sibilation  72 

D.2.  Data  table:  Sibilation  intelligibility  scores  for 

LPC  and  PLPC  processors  73 

D.3.  Analysis  of  variance  summaries; 

D, 3.1.  Sibilation  (Total)  76 

D,3.2.  Sibilation  (voiced)  77 

D.3,3,  Sibilation  (unvoiced)  78 

D.4.  Cumulative  distributions:  DRT  scores  for  sibilation 

D.4.1.  LPC-10  at  2400  BPS  with  bit  errors  79 

D.4.2.  PLPC  at  2400  BPS  with  bit  errors  79 

D.5.  Regression  models  and  scatter  plots:  sibilation  scores 
vs.  bit  error  rate 

D.5.1,  LPC-10  at  2400  BPS  80 

D.5.2.  PLPC  at  2400  BPS  80 

D.6.  Predicted  intelligibility  scores  for  sibilation  in 
presence  of  bit  errors 

D.6.1.  LPC-10  at  2400  BPS  81 

D.6.2.  PLPC  at  2400  BPS  81 

iii 


APPENDIX  E.  INTELLIGIBILITY  DATA  FOR  GRAVENESS  FEATURE 


E.l.  DRT  test  words  for  graveness  82 

E.2.  Data  table:  Graveness  intelligibility  scores  for 

LPC  and  PLPC  processors  84 

E.3.  Analysis  of  variance  summaries: 

E.3.1.  Graveness  (Total)  87 

E.3.2.  Graveness  (voiced)  88 

E.3.3.  Graveness  (unvoiced)  89 

E.4.  Cumulative  distributions:  DRT  scores  for  graveness 

E.4.1.  LPC-10  at  2400  BPS  with  bit  errors  90 

E.4.2.  PLPC  at  2400  BPS  with  bit  errors  90 

E.5.  Regression  models  and  scatter  plots:  graveness  scores 
vs.  bit  error  rate 

E.5.1.  LPC-10  at  2400  BPS  91 

E.5.2.  PLPC  at  2400  BPS  91 

E. 6.  Predicted  intelligibility  scores  for  graveness  in 

presence  of  bit  errors 

E.6.1.  LPC-10  at  2400  BPS  92 

E. 6.2.  PLPC  at  2400  BPS  92 

APPENDIX  F.  INTELLIGIBILITY  DATA  FOR  COMPACTNESS  FEATURE 

F. l.  DRT  test  words  for  compactness  93 

F.2.  Data  table:  Compactness  intelligibility  scores  for 

LPC  and  PLPC  processors  96 

F.3.  Analysis  of  variance  summaries: 

F .  3 . 1 . Compactness  (Total)  9 9 

F.3.2.  Compactness  (voiced)  100 

F.3.3.  Compactness  (unvoiced)  101 

F.4.  Cumulative  distributions:  DRT  scores  for  compactness 

F.4.1.  LPC-10  at  2400  BPS  with  bit  errors  102 

F.4.2.  PLPC  at  2400  BPS  with  bit  errors  102 

F.5.  Regression  models  and  scatter  plots:  compactness  scores 
vs.  bit  error  rate 

F.5.1.  LPC-10  at  2400  BPS  103 

F.5.2.  PLPC  at  2400  BPS  103 

F. 6.  Predicted  intelligibility  scores  for  compactness  in 

presence  of  bit  errors 

F.6.1.  LPC-10  at  2400  BPS  104 

F.6.2.  PLPC  at  2400  BPS  104 

APPENDIX  G.  SUMMARIES  OF  REGRESSION  MODELS  FOR  INTELLIGIBILITY  FEATURES 

G. l.  Linear  regression  equations  for  all  feature  states: 

LPC-10  at  2400  BPS  with  bit  errors  105 

G.2.  PLPC  at  2400  BPS  with  bit  errors  105 

G.3.  Confidence  limits  for  regression  coefficients,  all  feature 

states:  LPC-10  at  2400  BPS  with  bit  errors  106 

iv 


106 


G.4.  Confidence  limits  for  regression  coefficients,  all  feature 
states:  PLPC  at  2400  BPS  with  bit  errors 

G. 5.  Comparisons  of  predicted  and  actual  feature  scores: 

G,5.1,  Expected  feature  scores:  LPC-10  at  2400  BPS  107 

G. 5 . 2.  Expected  feature  scores : PLPC  at  2400  BPS  107 

G.5.3.  Predicted  97-1/2%  limits  of  data;  LPC-10  108 

G. 5,4,  Predicted  97-1/2%  limits  of  data:  PLPC  108 

APPENDIX  H.  TOTAL  DRT  INTELLIGIBILITY  SCORES 

H. l.  Data  table:  Total  DRT  intelligibility  scores  for  LPC  and 

PLPC  processors  at  2400  BPS  with  bit  errors  109 

H.2.  Analysis  of  variance  summary:  total  intelligibility  scores  112 

H.3.  Cumulative  distributions:  Total  DRT  intelligibility  scores 
for  LPC  and  PLPC  processors  compared  at  zero  bit  error 
rate,  by  speakers: 

H. 3.1.  Speaker  LL  113 

H,3,2,  Speaker  RH  113 

H.3.3.  Speaker  CH  114 

H.3.4.  Speaker  PK  114 

H.3.5.  Speaker  JE  115 

H.3.6.  Speaker  BV  115 

H. 4.  Regression  models  and  scatter  plots  for  total  DRT 

intelligibility  scores  vs,  bit  error  rate,  by  speakers: 

H.4.1,  Speaker  LL 

A.  LPC-10  116 

B.  PLPC  116 

H,4,2.  Speaker  RH 

A.  LPC-10  117 

B.  PLPC  117 

H.4.3.  Speaker  CH 

A.  LPC-10  118 

B.  PLPC  118 

H,4.4,  Speaker  PK 

A.  LPC-10  119 

B.  PLPC  119 

H,4,5.  Speaker  JE 

A.  LPC-10  120 

B.  PLPC  120 

H.4.6.  Speaker  BV 

A.  LPC-10  121 

B.  PLPC  121 

APPENDIX  I.  STATISTICAL  FORMULATIONS 

I. l.  Linear  regression  122 

1.2.  Lilliefors*  test  for  conformity  with  a normal  distribution  127 

1.3.  Bartlett’s  test  for  homogeneity  of  variance  128 

1.4.  Comparison  of  two  populations  by  paired  samples  129 

DISTRIBUTION  LIST  130 


V 


LIST  OF  ILLUSTRATIONS 


Figure  Title  Page 

1 Salient  parameters  of  LPC  and  PLPC  processor  configurations  4 

2 Distributions  of  total  intelligibility  scores  for  LPC-10  8 

3 Scatter  plot  of  scores,  and  linear  regression  model  for  total 

DRT  intelligibility  of  LPC-10  at  2400  BPS  with  bit  errors  10 

4 Linear  regression  models  for  individual  intelligibility 

feature  scores  for  LPC-10  at  2400  BPS  with  bit  errors  12 

5 Linear  regression  models  for  individual  speaker's  total 

intelligibility  scores  vs.  bit  error  rate,  for  LPC-10  14 

6 Distributions  of  total  intelligibility  scores  for 

piecewise  linear  predictive  coding  (PLPC)  at  2400  BPS  15 

7 Scatter  plot  of  scores,  and  linear  regression  model  for  total 

DRT  intelligibility  of  PLPC  at  2400  BPS  with  bit  errors  16 

8 Linear  regression  models  for  individual  intelligibility  feature 

scores  for  PLPC  at  2400  BPS  with  bit  errors  18 

9 Linear  regression  models  for  individual  speaker's  total 

intelligibility  scores  vs.  bit  error  rate,  for  PLPC  20 

10  Comparison  of  distributions  of  total  DRT  intelligibility  scores 

for  LPC  and  PLPC  at  2400  BPS  with  zero  bit  error  rate  24 

11  Comparison  of  distributions  of  total  DRT  intelligibility  scores 

for  LPC  and  PLPC  at  2400  BPS  with  l7o  bit  error  rate  24 

12  Comparison  of  distributions  of  total  DRT  intelligibility  scores 

for  LPC  and  PLPC  at  2400  BPS  with  37o  bit  error  rate  25 

13  Comparison  of  distributions  of  total  DRT  intelligibility  scores 

for  LPC  and  PLPC  processors  at  2400  BPS  with  57o  error  rate  25 

vi 


LIST  OF  TABLES 


Table  Nr.  Title  Page 

1 Predicted  intelligibility  performance  of  LPC-10  at  2400  BPS 

in  the  presence  of  bit  errors  10 

2 Comparison  of  actual  intelligibility  scores  and  scores  predicted 

by  the  linear  regression  model,  for  LPC-10  at  2400  BPS  11 

3 Summary  of  linear  regression  equations  describing  intelligibility 

scores  for  individual  features,  LPC-10  at  2400  BPS  in  the 
presence  of  bit  errors  12 

4 Analysis  of  variance  results  comparing  regression  slopes  for 

total  intelligibility  scores  of  individual  speakers,  obtained 
with  LPC-10  at  2400  BPS  with  bit  errors  13 

5 Predicted  intelligibility  performance  of  PLPC  at  2400  BPS 

in  the  presence  of  bit  errors  16 

6 Comparison  of  actual  scores  and  scores  predicted  by  the  linear 

regression  model,  PLPC  at  2400  BPS  17 

7 Summary  of  linear  regression  equations  describing  intelligibility 

scores  for  individual  features,  PLPC  at  2400  BPS  in  the  presence 
of  bit  errors  18 

8 Analysis  of  variance  results  comparing  regression  slopes  for  total 
intelligibility  scores  of  individual  speakers,  PLPC  at  2400  BPS  19 

9.1  Three-way  analysis  of  variance  results  comparing  intelligibility 
scores  for  LPC-10  and  PLPC  at  2400  BPS  with  bit  errors. 

Part  1.  Significant  differences  21 

9.2  Three-way  analysis  of  variance.  Part  2.  Significant  interactions 


22 

10  Comparison  of  total  intelligibility  scores  at  each  error  rate  23 

11.1  Results  of  pairwise  comparisons  of  LPC  and  PLPC  intelligibility 

scores:  Part  1.  Differences  favoring  LPC-10.  26 

11.2  Results  of  pairwise  comparisons  of  LPC  and  PLPC  intelligibility 

scores:  Part  2.  Differences  favoring  PLPC  27 

12.1  Analysis  of  variance  summary  comparing  regression  slopes  28 

12.2  Comparison  of  regression  slopes,  by  individual  speakers  29 

12.3  Comparison  of  regression  slopes,  individual  features  30 

vii 


1.0.  INTRODUCTION. 


The  susceptibility  to  bit  errors  manifested  by  different  voice 
digitizer  systems  represents  an  important  factor  for  test  and  evaluation, 
since  it  is  a performance  attribute  that  provides  a measure  of  the 
vulnerability  of  a system  to  jamming  and  interference  that  might  be 
encountered  in  a military  communications  environment.  Error  detection 
and  correction,  and  other  coding  schemes  imposed  on  the  data  stream 
generated  by  a voice  digitizer  can  provide  valuable  means  for  reducing 
this  susceptibility.  This  study,  however,  was  concerned  with  assessing 
intrinsic  vulnerability  of  two  narrowband  digital  voice  communications 
techniques  based  on  linear  predictive  coding  (LPC),  apart  from  any 
additional  protection  that  could  be  added  by  special  coding  schemes  of 
bit  placement,  data  smoothing,  error  detection  and  correction,  etc. 

Two  LPC-based  voice  processor  algorithms  were  evaluated.  One  used 
a conventional  version  of  LPC-10,  a linear  predictive  coding  arrangement 
in  which  ten  coefficients  were  calculated  from  analysis  of  the  speech 
signal  and  transmitted  together  with  pitch  and  energy  data  in  a narrow- 
band  digital  representation  at  2400  bits. per  second. 

The  second  version  was  based  on  a more  recent  innovation  called 
**piecewise’*  linear  predictive  coding  (PLPC),  which  also  utilized  analysis 
and  transmission  of  ten  coefficients  in  a 2400  BPS  data  stream.  However, 
in  this  case  the  LPC  coefficients  were  divided  between  a low-frequency 
band  of  speech  (six  coefficients)  and  a high-frequency  band  (four 
coefficients).  Prior  tests  and  evaluation  of  the  PLPC  method  have  shown 
that  a PLPC(6/4)  processor  configuration  resulted  in  highly  intelligible 
voice  transmission  at  2400  BPS.  The  speech  quality  was  almost 
indistinguishable  from  conventional  LPC;  however,  close  listening  left 
an  impression  that  the  consonant  sounds  were  crisper  and  clearer  than 
with  conventional  LPC  processing. 

The  earlier  studies  led  to  a conclusion  that  the  PLPC  innovation 
provided  advantages  both  thru  a small  improvement  in  speech  intelligibility 
in  comparison  with  conventional  LPC,  and  through  relaxing  the  speed 
and  computational  complexity  requirements  levied  on  a voice  processor 
terminal.  It  was  hypothesized  that  the  improvement  in  intelligibility 
derived  from  the  fact  that  piecewise  modeling  of  a speech  signal  contributes 
to  a more  accurate  representation  of  a voice  than  conventional  linear 
predictive  coding.  The  hardware  advantages:  a lowering  of  the  processor 
speed  requirement,  and  reduction  in  the  total  number  of  arithmetic  operations, 
offer  a potential  for  designing  a voice  processor  terminal  with  slower, 
less  costly  circuitry,  or  alternatively,  freeing  up  computational  capacity 
in  the  processor  terminal  that  could  be  time-shared  to  support  other 
functions  such  as  transmitting  and  receiving  modems,  signalling  and 
supervision,  acoustic  noise  abatement,  etc. 
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It  was  further  hypothesized  that  the  piecewise-LPC  approach  would 
have  advantages  for  reducing  vulnerability  to  bit  errors  incurred  in 
voice  transmission  over  an  imperfect  channel.  This  prediction  was  based 
on  consideration  of  the  added  redundancy  provided  by  the  PLPC  data  format. 
Since  the  LPC  coefficients  for  the  separate  frequency  bands  are  trans- 
mitted as  independent  paratneters,  when  a bit  error  occurs  in  one  of  the 
coefficient  values  it  can  affect  only  a limited  part  of  the  output  speech 
spectrum,  rather  than  affecting  the  entire  voice  spectrum  as  occurs  with 
conventional  LPC.  With  the  effect  of  a bit  error  segregated  to  only  a 
portion  of  the  output  signal,  it  was  anticipated  that  the  PLPC  vocoder 
design  would  establish  narrowband  speech  coin' Tunica t ions  providing 
intelligibility  and  quality  intrinsically  less  vulnerable  to  bit  errors 
(and  hence  to  jamming  and  interference)  than  a conventional  LPC  vocoder. 

An  objective  of  this  study  was  to  test  this  hypothesis. 

The  comparisons  of  performance  of  LPC  and  PLPC  techniques  assumed 
increased  importance  because  of  potential  advantages  foreseen  for  the 
PLPC  processor  in  implementation  of  a multiple-rate  processor  arrangement 
capable  of  supporting  wideband  as  well  as  narrowband  digital  speech 
communications  modes.  While  the  piecewise-LPC  approach  has  not  yet  been 
investigated  in  this  context,  the  two  prime  advantages  of  PLPC:  improved 
intelligibility,  and  relaxed  hardware  requirements,  would  in  principal 
carry  over  to  a wideband  version  that  provided  an  additional  data  component 
specifying  an  error  signal  (residual)  for  benefits  in  improved  speech 
quality  and  naturalness,  and  tolerance  to  acoustic  noise  environments, 

A voice  terminal  based  on  this  approach  would  include  an  8 or  9,6  Kbps 
transmission  mode  in  addition  to  the  2400  BPS  narrowband  configuration. 

By  embedding  the  narrowband  voice  data  in  the  wideband  data  stream, 
special  advantages  would  be  obtained  for  tandem  arrangements  of  wideband 
and  narrowband  digital  communications  channels. 

1.1.  Susceptibility  of  Intelligibility  Features  to  Bit  Errors. 

The  Diagnostic  Rhyme  Test  (DRT)  used  to  assess  speech  intelligibility 
performance  provides  assessment  of  intelligibility  scores  for  the  separate 
components  or  features  that  characterize  the  consonant  sounds  of  speech: 
voicing,  nasality,  sustention,  sibilation,  graveness , and  compactness , 
as  well  as  an  overall  intelligibility  score.  An  additional  objective  of 
this  study  was  to  assess  the  degree  to  which  individual  features  vary  in 
susceptibility  to  bit  errors.  Identification  of  the  features  having  the 
greatest  vulnerability  to  bit  errors  would  provide  guidance  in  devising 
refinements  of  the  speech  processing  algorithms  to  minimize  bit  error 
effects , 

1.2,  Susceptibility  of  individual  Speakers  to  Bit  Errors. 

Speech  intelligibility  testing  over  the  past  several  years  has  shown 
consistently  that  there  are  large,  significant  differences  in  intelligibility 
scores  of  different  speakers.  It  was  anticipated  that  different  individuals 
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would  vary  in  regard  to  the  effect  of  bit  errors  on  their  intelligibility 
scores*  This  question  is  important  from  the  point  of  view  of  determining 
confidence  limits  for  predicting  the  speech  intelligibility  that  might 
be  obtained  in  various  bit  error  environments.  It  would  be  highly 
desirable  to  be  able  to  make  a reliable  forecast  of  the  level  of  speech 
intelligibility  that  could  be  expected  for  95%  or  99%  of  the  population 
of  speakers  using  a digital  voice  communications  channel,  both  for  the 
condition  of  an  error-free  channel  and  at  specified  levels  of  bit  error 
rates  due  to  jamming  or  interference.  Tnese  tests  with  six  male  speakers 
and  several  bit  error  rates  represented  a step  towards  this  objective. 

1.3.  Regression  Models  relating  speech  intelligibility  scores  with 
bit  error  rate. 

Speech  intelligibility  data  obtained  in  these  tests  was  used  in 
calculating  linear  regression  models  relating  the  speech  intelligibility 
performance  and  the  bit  error  rate  conditions.  Slopes  of  the  regression 
lines  that  estimated  the  intelligibility  performance  in  the  presence  of 
bit  errors  can  be  interpreted  as  figures  of  merit  estimating  the 
susceptibility  of  particular  combinations  of  voice  processor,  speaker, 
and  intelligibility  feature,  to  the  effects  of  bit  errors.  The  linear 
regression  equations  also  permitted  interpolation  and  extrapolation  to 
predict  the  intelligibility  that  could  be  expected  at  additional  bit 
error  rates  from  those  actually  used  in  the  tests.  Confidence  limits 
were  also  calculated  Cor  these  estimates. 
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2.0.  TEST  AND  EVALUATION  PROCEDURES, 


Intelligibility  tests  followed  general  guidelines  laid  down  in 
previous  formal  tests  for  assessing  and  comparing  the  intelligibility 
performance  of  different  voice  processor  terminals.  The  salient  parameters 
of  the  LPC  and  PLPC  voice  processing  algorithms  are  summarized  in 
Fig.  1.  The  voice  processor  configurations  were  implemented  with 
software  running  on  the  CSP-30  Signal  Processor  in  the  Speech  Processing 
Laboratory  at  Air  Force  Electronic  Systems  Division  (IttJE).  Recordings 
of  intelligibility  tests  were  processed  with  a version  of  the  computer 
programs  that  permits  random  bit  errors  to  be  automatically  imposed 
on  the  data  stream  at  2400  BPS  that  connects  the  voice  analyser  and 
synthesizer. 


VOICE  PROCESSOR  CONFIGURATIONS 

LPC  at  2400  Bits  per  Second 

lOlh  order. 

4 Khz  bandwidth;  121  usee,  sample  rate. 

172  samples  per  frame,  20.8  msec  frame  duration. 
Gold-Rabiner  pitch  extractor. 

Interpolation. 

(Software  documented  as  Version  4-14-77) 

PLPC  at  2400  Bits  per  Second 

Two  bands;  crossover  point  20  db  down  at  2066  Hz. 

10  Coefficients  total  (6,4) 

121  usee,  sample  rate  with  downsampling  to  88  samples 
per  frame,  21.3  msec  frame  duration. 
Gold-Rabiner  pitch  extractor. 

I nterpolation. 

(Software  documented  as  Version  3-31-77) 


Fig.  I.  Salient  parameters  of  the  voice  processor  configurations. 
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In  the  real  world  it  is  more  common  for  bit  errors  to  occur  in 
bursts  or  clusters.  A random  distribution  of  bit  errors  was  judged  to 
be  a more  universal  case  (among  the  many  probability  distributions  that 
characterize  different  combinations  of  channels,  modems,  and  conditions 
of  the  channel)  but  also  a worst  case,  since  the  random  distribution 
causes  more  serious  degradation  of  intelligibility  than  one  in  which 
bit  errors  occur  in  clusters.  The  intelligibility  data  reported  here 
are  conservative,  since  the  intelligibility  under  typical  conditions 
of  wire  lines  and  radio  channels  in  which  bit  errors  are  clustered, 
will  probably  be  higher  than  the  values  reported  here  in  which  errors 
were  randomly  distributed. 

2.1.  Diagnostic  Rhyme  Test. 

The  intelligibility  test  recordings  were  based  on  Form  IV  of  the 
Diagnostic  Rhyme  Test  (DRT)  of  Voiers , Mickunas  and  Cohen,  a test  that 
provides  both  an  overall  intelligibility  score  and  diagnostic  data 
in  the  form  of  separate  scores  for  the  various  intelligibility  features. 
The  test  recordings  used  as  input  signals  were  prepared  in  an  earlier 
program  and  were  originally  recorded  in  a quiet  acoustic  chamber  using 
an  Altec  Model  659A  dynamic  microphone  fixed  in  a close- talking 
configuration.  (This  microphone  was  chosen  on  a basis  of  uniform 
frequency  response  and  low  distortion,  as  well  as  minimum  tendency  for 
blasting  effects  in  connection  with  the  plosive  sounds).  Bit  error 
conditions  included  zero  errors,  17o,  37o  and  57o  bit  error  rates.  Each 
condition  was  evaluated  by  processing  DRT  recordings  from  six  male 
speakers  (kept  constant  throughout  the  battery  of  tests),  each  speaker 
reading  192-word  DRT  lists  in  various  scramblings. 

Recordings  of  output  speech  resulting  from  this  processing  were 
subsequently  presented  diotically  over  headphones  to  listener  crews  of 
eight  naive  adults  (i.e.,  unsophisticated  with  regard  to  voice  processing 
technology);  the  listening  tests  were  conducted  in  the  ESD  sound  room 
located  in  the  speech  lab. 

Recordings  for  evaluation  of  each  bit  error  rate  condition  and 
each  processor  arrangement  (LPC  and  PLPC)  were  presented  to  the  listener 
crew  on  two  different  occasions,  in  a total  of  sixteen  sessions  spread 
over  a two  month  period.  (An  analysis  of  variance  indicated  that  the 
replications  did  not  result  in  significant  variations  in  test  scores). 

The  various  findings  reported  here  were  derived  from  analysis  of  the 
diagnostic  intelligibility  data  that  resulted  from  analysis  of  listener 
responses  in  those  sessions. 

2.2.  Analysis  of  variance. 

Various  subsets  of  the  data  were  analyzed  with  three-way  analysis 
of  variance  (processors,  speakers,  and  bit  error  rates)  to  assess 
qualitatively  the  significance  of  differences  between  intelligibility 
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scores.  For  overall  intelligibility  comparisons,  each  datum  was  a 
total  DRT  intelligibility  score  from  a single  listener;  the  eight 
listener  scores  and  two  presentations  of  the  recorded  test  were 
treated  as  sixteen  replications  of  the  data.  Intelligibility  scores 
for  the  separate  features  voicing^  nasality ^ sustention^  sibilation^ 
graveness , and  compactness  were  each  treated  as  a separate  population 
of  scores;  in  these  cases,  each  datum  was  an  average  response  of  the 
eight  listeners  in  a given  session. 

The  data  groupings  were  such  that  the  total  number  of  datum 
points  in  each  of  the  cells  in  the  analysis  of  variance  was  equal. 
Consequently  any  lack  of  homogeneity  of  variance  could  be  expected 
to  have  only  small  effect  on  the  outcomes  of  the  analysis  of  variance 
test  results. 

Variance  ratios  were  also  used  in  testing  for  significant  differences 
between  slopes  of  regression  lines  in  making  comparisons  of  the 
processors,  speakers,  and  intelligibility  features  in  terms  of  their 
separate  susceptibilities  to  effects  of  bit  errors. 

2.3,  Tests  of  normality,  and  of  equal  variance. 

The  linear  regression  model  is  based  on  assumptions  of  normality 
and  homogeneity  of  variance  for  the  distributions  of  the  dependent 
variable  (in  this  instance,  the  intelligibility  scores).  Conformity 
with  these  assumptions  was  tested  by  means  of  Lilliefor*s  test 
(for  conformity  with  a normal  distribution)  and  Bartlett's  test  (for 
Homogeneity  of  variance)  on  various  data  groups  consisting  of 
total  intelligibility  scores,  and  scores  for  individual  intelligibility 
features . 

2.4,  Paired  intelligibility  scores. 

A useful  method  for  assessing  the  significance  of  differences  in 
intelligibility  scores  involves  the  pairing  of  scores  and  an  assessment 
of  the  distribution  of  differences  between  the  members  of  the  pairs. 

In  this  instance  the  differences  of  interest  were  those  between  the 
scores  for  the  LPC  voice  processor,  and  the  PLPC  voice  processor,  with 
the  pairing  representing  a common  speaker  and  bit  e^ror  rate  condition. 

The  pairing  tended  to  compensate  for  average  differences  between  speaker 
scores,  and  average  differences  between  scores  for  different  bit  error 
rate  conditions,  which  would  tend  to  conceal  small  differences  in  scores 
for  the  processor  configurations. 

The  formulations  of  the  various  statistical  tests  are  summarized  in 
Appendix  I, 
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3.0.  NARROWBAND  VOICE  PROCESSOR  CONFIGURATIONS. 


The  two  versions  of  linear  predictive  vocoders  that  were  evaluated 
were  nearly  identical  in  most  details,  such  as  the  total  bandwidth  of  the 
voice  signal,  the  sampling  rate,  the  pitch  extractor  algorithm,  and  the 
duration  of  a data  frame.  The  essential  difference  was  that  the  convent- 
ional LPC  algorithm  used  the  linear  predictive  coding  process  to  model 
the  entire  voice  spectrum,  as  opposed  to  the  division  of  the  speech  signal 
into  frequency  bands  and  modeling  with  separate  linear  predictive  coding 
processes  for  each  band,  in  the  piecewise-LPC  configuration.  The  version 
of  PLPC  used  in  these  tests  involved  a low-frequency  band  and  a high- 
frequency  band,  with  a crossover  point  20  db  down  at  2066  Hz.  The 
technique  involves  a low-pass  translation  of  the  high  band  prior  to 
performing  the  c alculations  on  the  data  to  solve  the  linear  prediction 
equations.  After  transmitting  LPC  coefficients  for  each  of  the  bands  in 
a combined  2400  BPS  data  stream,  the  two  bands  are  separately  synthesized 
at  the  receiver,  followed  by  a band-pass  filtering  operation  that  results 
in  a correctly  restored  high-frequency  band  signal.  The  two  bands  are  then 
added  together  to  reconstruct  the  output  speech.  The  method  has  been 
described  by  Roberts  and  Wiggins  (1976). 

This  sequence  of  operations  in  the  PLPC  processor  halves  the  sample 
rate  involved  in  the  calculations  for  solving  the  predictor  coefficients 
(or  reflection  coefficients)  in  the  speech  analyzer,  as  well  as  reducing 
the  total  number  of  arithmetic  operations  in  comparison  with  conventional 
LPC.  In  addition  to  these  hardware  benefits  (for  implementing  PLPC), 
the  piecewise-LPC  method  has  the  advantage  of  modeling  a speech  signal 
with  improved  accuracy  (compared  with  conventional  LPC)  as  well  as  providing 
a new  dimension  of  flexibility  for  optimizing  the  assignment  and  coding 
of  the  LPC  coefficients  in  order  to  derive  maximum  performance  of  the 
processor. 

The  PLPC  configuration  used  in  these  tests  involved  six  coefficients 
assigned  to  the  low  frequency  band,  and  four  for  the  high  frequency  band. 
There  is  evidence  that  the  placement  of  the  frequency  bands,  as  well  as  the 
assignment  and  coding  of  the  coefficients,  could  be  refined  to  obtain 
further  advantages  in  improving  the  intelligibility  performance  in 
comparison  with  the  scores  reported  here  for  the  2400  BPS  configuration. 

In  any  case,  even  without  this  refinement,  it  will  be  shown  subsequently 
in  this  report  that  the  PLPC  processor  gave  higher  intelligibility  scores 
than  conventional  LPC,  tending  to  confirm  the  hypothesis  of  improved 
spectrum  modeling.  Further  refinements  of  the  PLPC  algorithm  to  take 
advantage  of  the  additional  degrees  of  freedom  available  for  optimizing 
performance  would  be  expected  to  further  increase  this  advantage. 
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4.0.  EFFECTS  OF  BIT  ERRORS  ON  LPC«10  AT  2400  BITS  PER  SECOND. 


Distributions  of  total  DRT  intelligibility  scores  at  the  four  bit 
error  rates  are  shown  in  Fig.  2.  A detailed  listing  of  total  scores  is 
given  in  Appendix  H. 


FOR  LPC-IO  AT  2400  BPS 


Fig.  2.  Distributions  of  total  intelligibility  scores  for  LPC-IO. 


In  these  plots  the  scores  have  been  ranked  and  plotted  as  cumulative 
proportions  of  the  data  set,  at  each  of  the  four  bit  error  rates.  Normal 
ogives  based  on  the  calculated  mean  and  standard  deviation  of  each  group  of 
data  are  also  shown.  As  there  were  six  speakers,  eight  listeners,  and 
two  presentations  of  the  test  at  each  bit  error  rate,  there  were  96  values 
for  each  of  the  distributions.  The  Lilliefors  test  statistic  indicated  that 
in  three  of  the  four  cases  the  data  distributions  were  reasonable  approxim- 
ations to  normal  curves.  The  exception  was  the  distribution  for  "zero 
error  rate"  condition,  which  indicated  significant  deviation  from  the 
normal  ogive.  Consequently  the  hypothesis  of  a normal  distribution  for  the 
"zero  bit  error  rate"  group  of  total  DRT  scores  obtained  with  the  LPC-IO 
processor  was  rejected  (a  = .01).  The  point  with  excessive  deviation 
occurred  in  connection  with  a score  of  92.7,  which  showed  a (normalized) 
deviation  of  0.119;  the  critical  value  for  p = .99  and  n = 96  was  0.105. 
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Bartlett *s  test  for  homogeneity  of  variances  indicated  that  the 
hypothesis  of  equal  variances  for  these  four  distributions  should  be 
rejected  (a  = ,001).  However,  in  regard  to  the  interpretation  of  analysis 
of  variance  tests  on  these  data,  Scheffe  (1959)  has  pointed  out  that 
inequality  of  variances  has  much  less  importance  (in  biasing  the  results) 
when  there  are  equal  numbers  of  datum  points  in  each  "cell"  of  the  data, 
a condition  that  was  satisfied  in  these  analyses. 

These  data  were  combined  in  calculating  the  linear  regression  model 
shown  with  the  scatter  plot  of  scores  in  Fig.  3,  The  regression  line 
(the  solid  line  in  this  figure)  presents  the  expected  relationship 
between  total  intelligibility  scores  and  bit  error  rate,  for  the  LPC-10 
processor  operating  at  2400  BPS.  The  model  yielded  an  estimated  score  of 
90.7  (average  score  of  six  male  speakers)  for  the  origin  of  the  regression 
line,  corresponding  to  zero  errors,  and  a negative  slope  of  4.45,  i.e. 
the  intelligibility  on  the  average  dropped  4,45  points  for  each  percentage 
point  increase  in  bit  error  rate.  Standard  significance  tests  (based  on 
assumptions  of  normality  and  equal  variance,  conditions  not  fulfilled  in 
these  distributions)  predict  that  the  95%  confidence  limits  of  the  slope 
of  the  "true”  regression  line  are  -4.69  and  -4.22.  The  value  of  r^ 
suggests  that  .778  of  the  variation  in  the  total  intelligibility  scores 
was  related  to  the  variations  in  bit  error  rate. 

The  mean  square  deviation  from  the  regression  line  was  20.96  for 
this  data  set.  Using  the  standard  error,  confidence  limits  were  calculated 
for  the  expected  value  estimated  by  the  regression  model,  and  confidence 
limits  for  the  population  of  individual  datum  points.  These  estimates  of 
predicted  performance  in  the  presence  of  bit  errors  are  summarized  in 
Table  1. 

Since  the  data  failed  to  fulfill  the  assumptions  of  normality  and 
homogenous  variances  required  for  significance  tests  of  the  linear 
regression  model,  it  was  of  interest  to  compare  the  values  predicted 
by  the  model  with  actual  values  from  the  data  distributions.  This  result 
is  presented  in  Table  2,  The  expected  values  forecast  by  the  model  showed 
good  agreement  with  average  scores  at  the  four  bit  error  rates,  estimating 
slightly  lower  scores  than  the  actual  data  at  zero  bit  error  rate,  and 
predicting  scores  slightly  higher  than  those  actually  obtained  at  the  57, 
bit  error  rate  condition.  This  pattern  may  be  due  to  the  truncation  of 
the  range  of  scores  at  100%,  or  could  possibly  derive  from  the  fact  that 
the  intelligibility  drops  off  at  high  bit  error  rates  more  than  a linear 
model  predicts,  i.e.  that  a non-linear  model  would  be  more  appropriate. 

The  comparison  of  the  values  exceeded  by  97-1/2%  of  the  datum  points 

may  also  involve  these  factors,  as  well  as  a tendency  for  the  variance  of 

the  intelligibility  scores  to  show  a negative  correlation  with  mean  scores. 
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AS  A FUNCTION  OF  BIT  ERROR  RATE 
95%  Cont  limits  ore  shown  for  the  expected  score,  ond  for  individuol  points 


Fig.  3.  Scatter  plot  of  scores,  and  linear  regression  model 
for  total  DRT  intelligibility  of  LPC-IO  at  2400  Bits 
per  Second,  in  the  presence  of  bit  errors. 


AV  ERAGE  INTELLIGIBILITY  ^ Bit  Error  Rote  . for  2400  BPS  LPC-IO 
Model:  S(LPC)*  90.66-4.454(BER%)  (Bosed  on  384  points) 


Bit 

Totol 

95%  Confidence  Limits 

Error 

Rote 

Intelligibility 

Expected  Avg.  Score  Individuol  Points 

0 

9 0.7 

89.95  - 9 1.36 

8 1 63 

- 

99  69 

1 

8 6.  2 

8565-  86.75 

7 7.  18 

- 

95.22 

2 

8 1.7 

8 1 28  - 8 2 21 

72.73 

- 

90  76 

3 

77.  3 

76.80-  77  79 

6 6 28 

- 

86  31 

4 

72  8 

72.22-  7 3.46 

63.8  1 

- 

8 1.86 

5 

68.4 

67.58-  6 9.  19 

5 9.35 

- 

7 7 42 

6 

63  9 

i 

62.92-  64.94 

54  87 

- 

72.99 

7 

59.5 

if 

Extrapolated 

58  25-  60.70 

50.39 

- 

68.56 

8 

55  0 

Vafuet 

53  57-  56  47 

45.90 

- 

64.14 

9 

50  6 

48  89-  52  25 

41  41 

- 

59  72 

10% 

46  1 

44  20-  48.02 

36  91 

- 

55.31 

Table  I.  Predicted  Intelligibility  performance  of  LPC-IO  at 
2400  bits  per  second  in  the  presence  of  bit  errors 
(with  no  provisions  for  error  protection). 
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COMPARISON  OF  PREDICTED  AND  ACTUAL  SCORES! 

TOTAL  INTELLIGIBILITY  OF  LPC-IO  AT  2400  BPS  WITH  BIT  ERRORS 
Regression  Model!  S * 90  7 - 4.45  R 


Score  Exceeded  by 

Bit  Error  Rote  Expected  (Avg.)  Score  97-1/2%  of  Speaker  / Listener 

Combinotions 


Regrtttion  Modti 

Actuol  Dofo 

Rtgrtition  Mod«l  Actuol  Doto 

ZERO 

90  7 

90  9 

816  (All 

; low  score  833) 

1 % 

86  2 

86.0 

77  2 

76.0 

3% 

77  3 

77.1 

68  3 

68.8 

5 % 

68  3 

66  7 

59  4 

56.3 

2. 

Comparison  of  actual 

intelligibility  scores  and 

scores  predicted  by  the  linear  regression  model, 
for  LPC-IO  at  2400  bits  per  second. 


4.1.  Susceptibility  of  scores  for  Intelligibility  Features  to 

bit  errors:  LPC-IO  at  2400  bits  per  second. 

Trends  in  scores  of  individual  intelligibility  features  derived 
from  the  evaluations  of  LPC-10  processor  performance  with  bit  errors 
are  summarized  in  Table  3.  Scores  for  graveness , summarized  in 
Appendix  E,  showed  the  greatest  average  susceptibility  to  bit  errors, 
with  a slope  of  -6.39  for  overall  scores  for  this  feature.  The 
scores  for  sibilation,  presented  in  Appendix  D,  were  at  the  other  extreme, 
with  an  average  regression  slope  of  -2.45.  Separate  linear  regression 
models  for  each  state  of  these  and  the  other  intelligibility  features, 
i.e.  with  the  feature  present  and  absent , voiced  and  unvoiced , etc. 
are  presented  in  the  Appendices,  together  with  cumulative  plots  of  the 
distributions  of  feature  scores  at  the  four  bit  error  rates,  and  tables 
estimating  the  predicted  intelligibility  scores  for  the  features  over 
a range  of  bit  error  rates.  The  regression  lines  for  average  scores 
associated  with  the  six  features  are  compared  in  Fig.  4, 
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LINEAR  REGRESSION  MODELS  FOR  LPC 


Intelligibility  Score  vs.  Bit  Error  Rate*  at  2400BPS 

Form:  DRT  Score  « a b R,  where  R»  B.E.Rin  percent 

Intelligibility  Feature  Regression  Equation  95%  Conf.  Limits 


VOICING 

NASALITY 

SUSTENTION 

SIBILATION 

GRAVENESS 

COMPACTNESS 

TOTAL  Intelligibility 


95.0  - 5.02  R 
98.6  - 3.73  R 
83.8  - 5.70  R 
88.3  - 2.45  R 

83.1  - 6.39  R 
95.2-  3.43  R 

90.7-  4.45  R 


-6.37i 

b5 

- 3.67 

-4.565 

b5 

- 2.91 

VI 

u> 

i 

b5 

-4.24 

-3.565 

b5 

- 1.34 

-7.88  5 

b5 

-4.91 

VI 

GO 

ro 

i 

b5 

-2.48 

-4.695 

b5 

-4.22 

Table  3.  Summary  of  linear  regression  equations  describing 
intelligibility  scores  for  individual  features. 

LPC-IO  at  2400  BPS  in  the  presence  of  bit  errors. 


AS  A FUNCTION  OF  SIT  ERROR  RATE 


Fig.  4.  Linear  regression  models  for  individual  intelligibility 
feature  scores  for  LPC-IO  at  2400  BPS  with  bit  errors. 
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ANALYSIS  OF  VARIANCE:  SPEAKER  DIFFERENCES 


Comparison  of  Six  Speokers  Regression  Slopes  for 
Totol  DRT  Intelligibility  Score  ^ Bit  Error  Rote 
with  2400  BPS  LPC-IO 


Source  of  Variotion 

Sum  of  Squores 

Meon  Squorc 

Deviations  from  Regression 

Six  Speakers 

372 

4762.754 

12  803 

Pooled 

372 

5 189  617 

13  950 

Diff  in  slopes 

5 

426  863 

85  373 

fl5  37:^ 

Testing  Hp  . No  difference  in  slopes,  F * ^ ^ 



s 6 668 

Reject  Hp 

Analysis  of  variance 

results  comparing  the  regression 

slopes  for  total  Intel 

1 igibil 

ity  scores  of  individual 

speakers,  LPC-IO  at  2400  BPS  with  bit  errors. 


4.2.  Susceptibility  of  Intelligibility  Scores  of  individual  Speakers 

to  bit  error  effects:  LPC-10  at  2400  BPS. 

Linear  regression  models  based  on  intelligibility  scores  reflecting 
the  performance  obtained  with  individual  speakers  were  calculated  in 
addition  to  the  regression  model  for  composite  performance  of  all  speakers. 
The  regression  slopes  obtained  from  these  analyses  were  tested  for  the 
hypothesis:  no  significant  difference  among  slopes  for  speakers.  This 
result  is  summarized  in  Table  4 and  Fig.  5.  The  hypothesis:  no  difference 
between  the  regression  slopes  estimated  for  individual  speakers,  was 
rejected  (a  = .001). 

Scores  for  Speaker  CH,  a speaker  who  customarily  obtains  the  highest 
intelligibility  scores  among  this  group,  resulted  in  a regression  line 
above  the  other  speakers,  and  at  all  points  more  than  2 points  above  the 
next  highest,  obtained  with  Speaker  BV.  Speaker  JE,  a speaker  whose  scores 
are  consistently  at  the  bottom  of  the  range,  resulted  in  the  lowest 
regression  line  and  the  greatest  slope,  -5,35, 

The  Lilliefors  test  indicated  that  distributions  for  total  DRT  scores 
of  each  of  the  six  speakers  were  reasonable  approximations  to  normal 
distributions. 
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100 


90 

L PC 
TOTAL 

BO 

DRT 

INTELLIGIBILITY 

(INDIVIDUAL 

SPEAKERS) 


60 


• 89  3-4  I 7 R 
90  8-4  46R 
93  7-3  70R 
88  9-4  94R 
B9  6-5  35R 
9 16-4  MR 


0 \ 2 
DRT  INTELLIGI8ILITY  OF 
AS  A FUNCTION  OF  81 


i 4 

2400  BPS  LPC 
T ERROR  RATE 


5%  B E R 


Fig.  5.  Linear  regression  moclels  for  incfivicfual  speaker’s 
total  Intelligibility  scores  vs.  bit  error  rate, 
for  LPC-IO  at  2400  bits  per  second. 


5.0.  EFFECTS  OF  BIT  ERRORS  ON  PLPC  AT  2400  BITS  PER  SECOND. 

Distributions  of  total  DRT  intelligibility  scores  obtained  with  the 
PLPC  processor  operating  at  2400  BPS  at  the  four  bit  error  rates  are  shown 
in  Fig.  6.  A detailed  listing  of  total  intelligibility  scores  is  presented 
in  Appendix  H. 

The  Lilliefors  test  statistic  indicated  that  three  of  the  four  bit 
error  rate  conditions  resulted  in  intelligibility  scores  that  were 
reasonable  approximations  to  normal  distributions.  The  exception  was 
the  distribution  for  the  1%  bit  error  rate  condition;  for  this  case  the 
test  indicated  significant  deviation  from  a normal  curve,  and  the  hypothesis 
of  conformity  with  a normal  curve  was  rejected  (a  = .01),  The  point  with 
excessive  deviation  corresponded  to  a total  DRT  score  of  90.62,  with  a 
(normalized)  deviation  of  0.122;  the  critical  value  for  p = .99  and  n = 96 
was  0.105.  Bartlett *s  test  for  homogeneity  of  variances  indicated  that 
the  hypothesis  of  equal  variances  should  be  rejected  (a  = .001).  These 
data  followed  the  usual  trend  in  intelligibility  scores,  with  variance 
tending  to  increase  with  a drop  in  scores. 
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TOTAL  DRT  INTELLIGIBILITY  SCORE 
FOR  lOth-Order  PLPC  (6/4)  AT  2400  BPS 


Fig.  6.  Distributions  of  total  intelligibility  scores  for 
Piecewise  Linear  Predictive  Coding  (PLPC). 


The  linear  regression  model  calculated  for  total  intelligibility 
scores  associated  with  the  PLPC  processor  is  presented  in  Fig.  7 in 
relation  to  the  scatter  plot  of  scores.  The  model  estimated  a score  of 
92.5  (six-speaker  average  score)  for  the  origin  of  the  regression  line 
(zero  bit  errors)  and  a slope  of  -4.18.  The  standard  significance  tests 
estimated  that  the  95%  confidence  limits  of  the  **true"  regression  slope 
were  from  -4.42  to  -3.95.  A comparison  of  the  scores  predicted  from  the 
regression  model  and  the  actual  data  values  is  made  in  Table  6,  As  with 
the  scores  for  LPC-10,  there  was  good  agreement  between  the  values  estimated 
by  the  model  and  the  actual  data  values,  even  though  the  data  distributions 
violated  some  of  the  underlying  assumptions  of  the  model.  The  comparison 
exhibits  the  same  trends  as  the  LPC-10  data,  in  which  the  predicted  values 
are  higher  than  the  actual  data,  at  the  5%  bit  error  rate. 
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TOTAL  DRT  INTELLIGIBILITY  OF  2400  BPS  PLPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 
95%  Conf  limits  ore  shown  for  the  expected  score , ond  for  iridividual  points 


Fig,  7.  Scatter  plot  of  scores,  and  linear  regression  model 
for  total  DRT  intelligibility  of  PLPC  at  2400  bits 
per  second,  in  the  presence  of  bit  errors. 


AVERAGE  INTELLIGIBILITY  y$.  Bit  Error  Rote  for  2400  BPS  PLPC 
Model:  S(PLPC}  - 92.46  - 4,I84(BER%)  (Boted  on  384  points) 


Bit 

Totol 

95%  Confidence 

Limits 

Error 

Rote 

Intelligibility 

Expected  Avg.  Score 

Individual  Points 

0 

92.5 

91.75  - 93. 16 

83  49-101.42 

1 

88.3 

87.73  - 88  81 

79  3 1 - 97.23 

2 

84  1 

83.63-  84.55 

75.  13-  9304 

3 

79.9 

79.41  - 8 0.39 

70  95-  88  85 

4 

75,7 

75.10-  76.33 

66  76-  84  68 

5 

71  . 5 

70  74-  7 2 33 

62  56-  80  51 

6 

67,3  1 

66.35-  68.35 

58  35  - 76  34 

7 

63.2  Extrapolated  61.95-  64.38 

54.  14  - 72.  19 

8 

59.0  Values 

57.54-  60.42 

49  93  - 68.03 

9 

54  8 

53.13-  56  46 

45.70  - 63.89 

10% 

50.6 

48  71  - 52.51 

41.47  - 59.75 

Table  5.  Predicted  intelligibility  performance  of  PLPC  at 

2400  bits  per  second  In  the  presence  of  bit  errors 
(with  no  provisions  for  error  protection). 
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COMPARISON  OF  PREDICTED  AND  ACTUAL  SCORES! 

TOTAL  INTELLIGIBILITY  OF  PLPC  AT  2400  BPS  WITH  BIT  ERRORS 
Regre»$lon  Mo<J«l:  S • 92.5  - 4.  I B R 

Score  Exceeded  by 

Sit  Error  Rate  Expected (Avg.)  Sco^’e  97-I/2V*  of  Speoker/ Li»ler>er 

Combinotions 


Rtgrttslon  Madtf 

Actual  Data 

Rtgrtttion  Modtl 

Actual 

ZERO 

92.5 

92  4 

83  5 

8 5.4 

1 % 

88  3 

88  0 

793 

802 

3% 

79  9 

80  6 

71.0 

72.9 

5% 

71.5 

71  ,2 

626 

58  3 

Table  6.  Comparison  of  actual  intelligibility  scores  and 

scores  predicted  by  the  linear  regression  model, 
for  PLPC  at  2400  bits  per  second. 


5.1.  Susceptibility  of  scores  for  Intelligibility  Features  to  bit 

errors:  PLPC  at  2400  bits  per  second. 

Linear  regression  equations  representing  the  average  trends  in 
scores  for  the  individual  intelligibility  features  are  summarized  in 
Table  7.  The  analysis  indicated  a pattern  of  susceptibility  to  bit  errors 
similar  to  that  obtained  with  LPC-10,  in  which  the  scores  for  the  feature 
graveness  with  an  average  slope  of  -5.75  indicated  the  greatest  suscepti- 
bility, scores  for  sibilation  with  an  average  slope  of  -3.35  evidencing 
the  least  susceptibility.  Regression  lines  for  average  scores  for  the 
six  principal  features  are  compared  in  Fig.  8.  Detailed  listings  of 
scores  for  the  separate  features  and  cumulative  distributions  are  presented 
in  the  Appendices,  as  well  as  tables  predicting  feature  scores  over  a 
range  of  bit  error  rates. 
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LINEAR  REGRESSION  MODELS  FOR  PLPC 

Inrelligibility  Score  vs.  Bit  Error  Rote,  at  2400 BPS 
Form:  DRT  Score  = a b R,  where  R=B.E.R.in  percent 


Intelligibility  Feature 

Regression  Equation 

95%  Conf.  Limits 

VOICING 

96.3  - 

3.63  R 

-4.66  ^ 

b<-  2.5S 

NASALITY 

98.3- 

3.65  R 

VI 

GO 

1 

bs  - 2.83 

SUSTENTION 

84.1  - 

4.91  R 

-6.33  < 

b<  - 3.50 

SIBILATION 

95.6- 

3.35  R 

VI 

o 

b^  - 2.60 

GRAVENESS 

85.3  - 

5.75  R 

-7.34  ^ 

b<  - 4.15 

COMPACTNESS 

95.1  - 

3.82  R 

-4.87  < 

b<-2.77 

TOTAL  Intelligibility 

92.5- 

4.18  R 

VI 

C\J 

1 

b^  -3.95 

Table  7.  Summary  of  linear  regression  equations  describing 
Intelligibility  scores  for  individual  features, 

PLPC  at  2400  BPS  in  the  presence  of  bit  errors. 


PLPC 

INTELLIGJ8ILITY 

SCORE 


100 


eo 


60 


40 


20 


0 

0 I 2 3 4 5%  B E.R. 

FEATURE  INTELLIGIBILITY  OF  2400  BPS  PLPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 




Intelligib<  Mty  Lmeor  Regression 

Feoture 

Equal  ion 

VOICING  $ = 

96  3 - 3 63  R 

NASALITY 

98  3 - 3 65  R 

SUSTENTION 

84  1 • 4 91  R 

SIBILATION 

95  6-  3 35R 

GRAVENESS 

85  3*  5 75  R 

COMPACTNESS 

95  1 - 3.82R 

J 1 1 

Fig.  8.  Linear  regression  models  for  individual  intelligibility 
feature  scores  for  PLPC  at  2400  BPS  with  bit  errors. 
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5.2.  Susceptibility  of  intelligibility  scores  of  individual  Speakers 
to  bit  error  effects:  PLPC  at  2400  bits  per  second. 

Total  DRT  intelligibility  scores  obtained  with  each  of  the  six 
speakers  tested  in  combination  with  the  PLPC  processor  were  utilized  in 
separate  calculations  of  linear  regression  models,  tests  for  normality 
of  the  distributions  of  scores,  and  for  equal  variances.  An  analysis 
of  variance  testing  the  hypothesis  of  no  difference  in  slopes  of  the 
regression  lines  of  the  six  speakers  indicated  that  the  hypothesis  of 
equal  regression  slopes  should  be  rejected  (a  = .001).  This  finding  is 
summarized  in  Table  8. 

Linear  regression  models  based  on  total  scores  for  each  of  the  six 
speakers  in  tests  of  PLPC  are  presented  in  Fig.  9. 


ANALYSIS  OF  VARIANCE!  SPEAKER  DIFFERENCES 


Comporison  of  Six  Speokers  : Regression  Slopes  for 
Totol  DRT  Intelligibility  Score  ^ Bit  Error  Rote 
with  2400  BPS  Piecewise  - LPC 


Source  of  Voriotion 

d f 

Sum  of  Squores 

Meon  Squore 

Deviotions  from  Regression 

Six  Speokers 

372 

4642  071 

12  479 

Pooled 

372 

5487  151 

14.750 

Ditf.  in  slopes 

5 

845.081 

169.016 

Testing  H*!  No  difference  in  slopes.  F « 47^  * 13.544*** 

Reject  H* 


Table  8.  Analysis  of  variance  results  comparing  the  regression 
slopes  for  total  Intelligibility  scores  of  Individual 
speakers,  PLPC  at  2400  BPS  with  bit  errors. 
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95  4-4  I 9R 
9 17-5  TOR 
89  6 - 3 94R 
93  0-4  33R 


0 12  3 4 5%BER. 

DRT  INTELLIGIBILITY  OF  2400  BPS  PLPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 


Fig.  9.  Linear  regression  models  for  individual  speaker's 
total  intelligibility  scores  vs.  bit  error  rate, 
for  PLPC  at  2400  BPS. 


6.0.  COMPARISONS  OF  PERFORMANCE  OF  LPC  AND  PLPC  OPERATING  AT  2400 

BITS  PER  SECOND  IN  THE  PRESENCE  OF  BIT  ERRORS. 

A variety  of  statistical  tests  were  performed  on  the  speech 
intelligibility  scores  to  test  the  hypothesis  that  the  LPC  and 
PLPC  processor  configurations  differed  significantly  in  terms  of 
speech  intelligibility  performance . 

6.1.  Analysis  of  variance  findings. 

Results  of  a battery  of  three-way  analysis  of  variance  tests 
are  summarized  in  Tables  9.1  and  9.2;  the  three-way  classification 
was  by  processors,  speakers  and  bit  error  rates.  Detailed  summaries 
with  sums  of  squares,  mean  squares,  and  variance  ratios  are  given  in 
the  Appendices,  together  with  the  data  tables  that  were  the  basis  for 
these  results. 
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THREE-WAY  ANALYSIS  OF  VAR  I A NC  E I SU  MMARY  OF  RESULTS  OF  COMPARING 
2400  BPS  LPC  AND  PLPC  INTELLIGIBILITY  SCORES 


INTELLIGIBILITY 

FEATURE 


SIGNIFICANT  DIFFERENCES 


PROCESSORS 
(LPC  a PLPC) 


SPEAKERS 
(6  Malts) 


Bit  Error  Rottt 
(Four  BER't) 


VOtCING 

Prtttnf 

Abstni 


KM  (p 
KMK  (p 


.997) 

9991 


KKM  (p*  999) 
KKM  (p*  .999) 
KKM  (p«  999) 


KK*  (p'  999) 
KKK  Ip*  .999) 
KMtt  (pi. 999) 


NASALITY 

Prtttnt 

Abstnf 


K Ip-. 954) 


K»K  (p  ■ .999) 
KMK  Ip-  999) 


KKK  (p  ■ .999  ) 
KKK  (p-  999) 
KKK  (p-  999) 


SUST  ENTION 
Votcf  tf 
UfivOiCtd 


K (p  ■ .988) 


KItM  (p-  999) 
KKK  (p-  999) 
*KK  Ip  - 999) 


MMM  (p-  999) 
KKM  (p-  999) 
*KK  (p-  999) 


SIBILATION 

Votctd 

Unvoicvd 


KMM  Ip  - 999  ) 
KK  Ip  - 998) 
KMM  (p  - .999) 


KMM  (p-  999) 
KK  Ip.  997  ) 
K^K  (p-  999) 


(p-  999) 
KKK  |p«  999) 
KMM  (p-  999) 


GRAVENESS 

VoiC9d 

Unvoictd 


Ip  • 
Ip  • 


985) 
961  ) 


M (p*  988) 
KK  (p-  998) 


KMM  Ip  - 999) 
•M-KM  (p  - 999) 
KKK  Ip-  999) 


COMPACTNESS 

Voicfd 

Unvoicwd 


KKM  (p-  999) 
»MK  Ip-  999) 
»KK  Ip-  999) 


(p-  .999) 
MKK  (p.  .999) 
KKK  Ip-  999) 


TOTAL  INTELLIGIBILITY 


KKM  Ip-  999) 


KKK  (p-.999)  KMM  (p  - 999) 


Table  9.1.  Three-way  analysis  of  variance  results  comparing 
intelligibility  scores  for  LPC-IO  and  PLPC  at 
2400  BPS  in  the  presence  of  bit  errors. 


The  analysis  of  variance  was  predicated  on  a fixed-effects  model, 
from  a rationale  that  the  six  speakers  were  common  to  the  entire  battery 
of  tests,  as  were  the  majority  of  the  listener  crew.  A case  can  also  be 
made  for  a mixed-effects  model,  from  the  reasoning  that  the  random  bit 
error  effects  involved  successive  samplings  of  a randomly  distributed 
variable.  The  tables  of  mean  squares  listed  in  the  Appendices  are 
provided  in  order  to  permit  the  option  of  calculating  significance  tests 
from  this  alternative  point  of  view. 

The  analysis  of  variance  indicated  that  about  half  of  the  intelligi- 
bility scores  for  individual  features,  as  well  as  the  total  scores, 
evidenced  significant  differences  between  the  LPC  and  PLPC  processor 
configurations.  All  of  the  feature  scores  showed  significant  differences 
due  to  bit  error  rate  conditions,  and  nearly  all  were  characterized  by 
significant  differences  between  the  six  speakers. 
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The  analysis  of  variance  also  revealed  that  significant  interactions 
between  processors  and  speakers  were  present  for  the  majority  of  the 
intelligibility  features,  as  well  as  total  intelligibility  scores. 

The  total  scores,  and  a few  feature  scores,  showed  significant  interactions 
between  speakers  and  bit  error  rates,  and  between  processors  and  bit 
error  rates.  These  results  are  summarized  in  Table  9.2. 

A further  group  of  tests  were  conducted  on  total  intelligibility 
scores  at  each  of  the  four  bit  error  rates,  testing  the  significance  of 
the  difference  in  mean  scores  for  the  LPC  and  PLPC  processors.  These 
results  are  summarized  in  Table  10. 


THREE-  WAY  ANALYSIS  OF  VARIA  NCE  ! SUMMARY  OF  RESULTS  OF  COMPARING 
2400  BPS  LPC  AND  PLPC  INTELLIGIBILITY  SCORES 

SIGNIFICANT  INTERACTIONS 

INTELLIGIBILITY  Processors  ond  Processors  ond  Soeokcrs  ond 

FEATURE  Speokers  Bit  Error  Rotes  Bit  Error  Rotes 


VOICING 

Prf%0nt 

Abfnf 

NASALITY 

Pr»t9nl 

Ab$0i*l 

SUSTENTION 

Voiced 

Unvoiced 

SIBILATION 
Voic  ed 
Unvoiced 

GPAVENESS 

Voiced 

Unvoiced 

COMPACTNESS 
Voiced 
Un  voiced 

TOTAL  intelligibility 


M (p  s 956 ) 
tfXJf  (p»  .999) 


(p»  .999) 
(p».999) 
(p«  990) 

(p>.9  93) 
* (p».977) 
KH  (p>  .998) 

IHf  (p»  .996) 
KM  (p*  996) 
MMK  (p*.999t 


(p«  .995) 
MMK  (p>.999) 

(p>  999) 


(p«.999) 


# (p«  979) 


9HS  (p«  .994) 
« (p*  .974) 


(p*.999  ) 


Ip*. 999) 
Ip*. 999) 


KM  Ip*  . 995) 
^<*|p*.965) 


lp*.999) 


Table  9.2.  Significant  interactions  revealed  in  the  three-way 
analysis  of  variance  summarized  in  Table  9.1. 
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COMPARISON  OF  MEAN  INTELLIGIBILITY  SCORES 
Six  Speakers,  Two  Replications,  per  Condition 


LPC 

PLPC 

(1) 

Diff.  F 

(with  1 a 165  d.f.) 

Zero  Bit  Errors 

90.92 

92.39 

1 48 

2 1.6  38***  {p>.999) 

l7o 

85.98 

88.01 

2.03 

20.822***  {p>.999) 

37o 

77  08 

80.58 

3.49 

44.360’"*’*  {p>.999) 

57o 

68.55 

71. 18 

2.63 

18.443***  {p>.999) 

(I)  Differences  in  avg  scores  were  significant  at  the  .00/  level. 

Table  10.  Comparison  of  total  DRT  intelligibility  scores 
obtained  with  LPC-IO  and  with  PLPC  at  each 
bit  error  rate  condition. 


Differences  between  mean  intelligibility  scores  (six  speakers) 
for  the  LPC  and  PLPC  processors,  although  small,  were  highly  significant 
at  each  bit  error  rate  condition.  Distributions  of  the  total  scores 
at  each  bit  error  rate  condition  are  compared  in  Figs.  10  through  13, 
with  the  normal  ogive  based  on  the  mean  score  and  standard  deviation 
of  the  data  in  each  distribution  shown  for  comparison.  In  every  case, 
the  piecewise-LPC  processor  obtained  a higher  intelligibility  score 
than  the  conventional  LPC  processor  configuration. 
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Fig.  10.  Comparison  of  distributions  of  total  DRT  intelligibility 
scores  for  LPC  and  PLPC  at  2400  BPS  with  zero 
bit  error  rate. 


Fig.  II.  Comparison  of  distributions  of  total  DRT  intelligibility 
scores  for  LPC  and  PLPC  at  2400  BPS  with  1%  bit 
error  rate. 


24- 


Fig.  12.  Comparison  of  distributions  of  total  DRT  intelligibility 
scores  for  LPC  and  PLPC  at  2400  BPS  with  3%  bit 
error  rate. 


TOTAL  ORT  INTELLIGIBILITY  SCORE 

Fig.  13.  Comparison  of  distributions  of  total  DRT  intelligibility 
scores  for  LPC  and  PLPC  at  2400  BPS  with  5%  bit 
error  rate. 
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6.2.  Pairwise  comparison  of  intelligibility  scores. 

The  intelligibility  scores  for  LPC  and  PLPC  processor  configurations 
were  further  compared  through  a pairwise  comparison  of  scores.  The 
pairing  involved  an  LPC  intelligibility  score,  and  a PLPC  score,  for  a 
common  speaker  and  bit  error  rate  condition.  The  distribution  of 
differences  in  scores,  between  the  members  of  the  pairs,  was  utilized 
in  testing  for  the  significance  of  the  average  difference  between  the 
performance  of  the  LPC  and  the  PLPC  processors,  over  all  bit  error  rate 
conditions  and  speakers.  The  pairing  had  the  effect  of  normalizing 
against  variance  due  to  speaker  effects  and  bit  error  effects  that  would 
otherwise  tend  to  mask  out  the  significance  of  small  differences  between 
the  performance  of  the  processors.  Cases  in  which  the  score  for  the 
LPC  processor  was  significantly  better  than  the  PLPC  processor  are  shown 
in  Table  11.1;  cases  showing  a significant  advantage  for  PLPC  in  Table  11.2. 


COMPARISONS  OF  LPC  AND  PIECEWISE  - LPC  AVERAGE  INTELLIGIBILITY  SCORES 
Zflro,  1%,  3%  ond  5%  Bit  Error  Rotos  o1  2400  BPS 
PART  I.  SIGNIFICANT  DIFFERENCES  FAVORING  LPC 


INTELLIGIBILITY  FEATURE 

FEATURE  PRESENT 


VOICING  (Avg  ) 

Fncltonol  — 

Non  ~ Fricttonol  - 

nasality  (Avg  } 

Gfovt  - 

Acuft 

SUSTENTION  {Avg  } 

Votctd  - 

Unvoicod  - 

SIBILATION  {Avg  I 

Voiced  - 

Unvoiced  - 

GRAVENESS  <Avg  ) 
voiced 

Unvoiced  — 

COUPACTNESS  (Avg  ) 3.22" 

Voiced  4.43* 

Unvoiced  — 

TOTAL  DRT  INTELLIGIBILITY  SCORE.' 


FEATURE 

ABSENT 


5 0 8* 


FEATURE 

AVERAGE 


Table  II. I.  Results  of  pairwise-comparison  of  LPC  and  PLPC 
intelligibility  scores;  Differences  favoring  LPC-IO. 
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COMPARISONS  OF  LPC  AND  PIECEWISE  - LPC  AVERAGE  INTELLIGIBILITY  SCORES 


Ztro,  1%  , 3%  ond  5*4  Bif  Error  Roftt  of  2400  BPS 
PART  2.  SIGNIFICANT  DIFFERENCES  FAVORING  PIE  CEWI S E - LPC 


INTELLIGIBILITY  FEATURE  FEATURE  FEATURE 

FEATURE  PRESENT  ABSENT  AVERAGE 


VOICING  (Avg  ) 
Frictionol 
Non  - FfKlional 

NASALITY  lAvg) 

G rovo 
Acufo 

SUSTFNTION  (Arg  ) 
Voicod 
Un¥aiC9d 

SIBILATION  (Avg  } 
votcod 
Un  votcod 

GRAVENESS  (Avg  } 
voictd 
Unvofctd 

COkIRACTNESS  (Avg  } 
Voicod 
Un  voictd 


e 79 
13  02* 


12  57 

7 42* 


r0r4L  ORT  INTELLIGIBILITY 


SCORE 


3 06 
7 00*' 
I I 05*' 


2 41 


««• 


4 49** 


5 


0 I 


«• 


5.11* 


5 2 I 

5 18** 


3 66 
3.06 


4 26  * 


Table 


II.  2. 


Results  of  pairwise-comparison  of 
intelligibility  scores:  Differences 


LPC  and 
favoring 


PLPC 

PLPC. 


As  there  are  nine  cases  associated  with  each  of  the  intelligibility 
features,  i.e,  three  scores  when  the  feature  was  present  (for  example, 
voiced,  unvoiced,  and  total  of  voiced  and  unvoiced  cases),  three  for  the 
feature  absent , and  three  for  the  total  cases  for  present  and  absent , 
a total  of  54  diagnostic  intelligibility  scores  are  involved  in  the  total 
summary,  plus  a total  score  for  overall  intelligibility.  Thus  the  results 
of  the  pairwise  tests  represented  55  separate  assessments  resulting  in  a 
detailed  listing  of  salient  differences  of  intelligibility  performance 
for  the  two  processors.  In  approx,  two-thirds  of  these  cases,  the 
difference  was  not  statistically  significant.  The  significant  differences, 
shown  in  these  tables,  included  three  cases  favoring  LPC,  and  twenty 
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cases,  as  well  as  the  overall  intelligibility  scores,  showing  a significant 
bias  favoring  the  PLPC  processor* 

6.3.  Comparison  of  regression  slopes:  LPC  and  PLPC  total  DRT 

intelligibility  scores  vs.  bit  error  rate. 

Further  comparisons  of  the  LPC  and  PLPC  total  intelligibility 
scores  were  made  in  comparing  their  susceptibilities  to  bit  errors 
as  estimated  by  the  slopes  of  the  regression  lines  relating  intelligibility 
and  bit  error  rate.  An  analysis  of  variance  was  made  to  test  the 
hypothesis:  no  difference  in  regression  slopes.  The  test  was  performed 
with  the  composite  data  for  all  six  speakers;  separate  tests  were  also 
made  comparing  the  regression  slopes  calculated  for  LPC  and  PLPC  on 
a speaker-by-speaker  basis. 

The  results  of  testing  the  composite  data  are  shown  in  Table  12.1. 

(The  basis  of  the  test  is  summarized  in  Appendix  I.)  The  difference 
between  the  regression  slope  calculated  for  the  LPC  processor  scores 
( -4.45)  and  the  slope  calculated  for  the  PLPC  scores  ( -4.18)  was  not 
significant,  either  in  the  original  data  or  after  an  adjustment  for 
differences  in  speaker  means.  However,  comparing  the  LPC  and  PLPC 
regression  lines,  speaker  by  speaker,  it  was  revealed  that  the  scores 
for  four  of  the  six  speakers  showed  a significant  advantage  for  the 
PLPC  processor.  The  difference  in  slopes  for  the  remaining  two  speakers 
was  not  significant.  This  result  is  summarized  in  Table  12.2. 


ANALYSIS  OF  VARIANCE:  PROCESSOR  DIFFERENCES 
Comporing  2400  BPS  LPC  ond  Piecewise  - LPC  Regression  Slopes 
for  Total  ORT  Intelligibility  Score  vs.  Bit  Error  Rote 


Source  of  Vorionce 

d.f. 

Sum  of  Squores 

Meon  Squore 

Deviations  from  Regression 

ProctiiortILPC  8 PLPC) 

764 

15902.556 

20  615 

Pooled 

764 

15953  429 

20  662 

Diff  in  slopes 

1 

50  873 

50  873 

Testing  H*'.  No  difference  in  slopes,  F*  ■ 

cU.  o 1 D 

Adjusted  for  Soeoker  differences: 

2,444  ( p = .882) 

Deviotions  from  Regression 

Proce»tor»(  LPC  a PLPC) 

764 

1 1 20 1 1 5 1 

1 4 661 

Pooled 

764 

1 1 252  eol 

1 4.729 

Diff  in  slopes  i 5 i 650 

Testing  Ho!  No  difference  in  slopes,  F * ^ * 3.523  ( p = 939) 

14.00 1 


Table  (2.1.  Analysis  of  variance  summary  comparing 

linear  regression  slopes:  total  DRT  intelligibility 
scores  for  LPC-IO  and  PLPC.  (All  speakers). 
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ANALYSIS  OF  VARIANCE!  PROCESSOR  DIFFERENCES 


Comporing  2400  BPS  LPC  and  Piecewise  • LPC  Regression  Slopes 
by  Individuol  Speokers’  Totol  Intelligibility  Score  vs  Bit  Error  Rote 


Testing  H«  : No  difference  in  slopes 


SPEAKER 

b * 

LPC 

slope 

PLPC 

F * Variance 

ratio  (with 

1 and  124  d f ) 

LL 

-4  17 

-3.10 

9 1 1 7 

(P  • 997) 

REJECT  H. 

RH 

-4  46 

-3.75 

4 552* 

(p  • 965) 

REJECT  H. 

CH 

- 3.70 

-4  19 

3 756 

(p  • 945) 

PK 

-4  94 

-5.70 

4 355* 

(p  - 961) 

REJECT  H. 

J E 

’5  35 

-3  94 

16  810*** 

( p • . 999) 

REJECT  H. 

BV 

-4  1 1 

-4  33 

0 459 

Table  12.2.  Analysis  of  variance  results  comparing  linear 
regression  slopes,  total  Intelligibility  scores 
for  LPC-10  and  PLPC,  by  Individual  speakers. 


6.5.  Comparisons  of  regression  slopes:  intelligibility  feature  scores 

for  LPC  and  PLPC  processors , vs . bit  error  rate . 

Tests  of  the  scores  for  individual  intelligibility  features 
revealed  that  the  majority  of  the  distributions  of  feature  scores  at  the 
various  bit  error  rates  failed  to  meet  the  requirements  of  being  normally 
distributed,  and  of  equal  variances  at  the  various  bit  error  rates. 
Significance  tests  of  the  regression  data  are  therefore  in  question; 
however,  the  results  of  these  tests  may  have  value  in  contributing  to 
understanding  of  the  nature  and  degree  of  difference  in  intelligibility 
performance  of  the  LPC  and  PLPC  processors  in  the  presence  of  bit  errors. 

Detailed  tables  of  regression  equations  and  estimates  of  the  95% 
confidence  limits  for  the  slopes  for  the  various  feature  scores  are 
contained  in  Appendix  G;  tables  comparing  the  feature  scores  predicted 
by  the  regression  models,  and  the  actual  data,  are  also  presented. 

A portion  of  this  data  was  examined  in  analysis  of  variance  tests  of 
the  difference  in  regression  slopes  for  the  LPC  and  PLPC  processor  scores. 
The  results  are  presented  in  Table  13.  Of  the  eighteen  cases  that  were 
tested,  eleven  showed  a smaller  slope  for  the  PLPC  scores,  i.e.  estimated 
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smaller  susceptibility  to  bit  errors.  Seven  of  the  comparisons  showed 
the  opposite  bias,  favoring  LPC.  However,  the  variance  ratios  did  not 
exceed  the  critical  value  in  any  of  these  tests;  as  a result,  the  hypoth- 
esis of  no  difference  in  regression  slopes  was  not  rejected.  Speaker 
variability,  and  the  smaller  number  of  datum  points  involved  in  these 
comparisons,  were  factors  that  influenced  this  outcome. 


Intelligibility  Feoture  Scores  vs  Bit  Error  Rote 


Testing 

INTELLI6I8ILITY 

FEATURE 


Ho  = No  difference 

b = SLOPE 
LPC  PLPC 


in  slopes 

F (d  1 ) p 


VOICING  ( Avg  ) 

- 5 02 

- 3 63 

2 611 

(1,380) 

0 893 

Frictional 

- 4 4 1 

- 3 58 

0 549 

(1.  188) 

Non  • Ffietionol 

- 5 63 

- 3 67 

2 306 

(1,  188) 

0 869 

nasality  ( Avg  ) 

- 3 73 

- 3.65 

0.019 

(1,380) 

Grovo 

- 4 01 

- 3 57 

0 252 

(1.  188) 

Acvt0 

- 3 46 

- 3 74 

0.126 

(1,  188) 

S USTENTION  (Avg  ) 

- 5 70 

- 4 91 

0 5 85 

(<.380) 

V0IC9d 

- 7 1 9 

- 4 45 

3 206 

(1,  188) 

0 925 

Unvoicfd 

- 4 2 1 

- 5 37 

0 894 

(1,  188) 

SIBILATION  (Arg  1 

- 2 45 

- 3 35 

1 772 

(1,380) 

0 816 

V0lC9d 

- 2 30 

- 2 61 

0 1 19 

(1.  188) 

Un¥oic9d 

- 2 60 

-4  09 

2.195 

(1,  188) 

0 860 

GRAVENESS  (Avg.) 

- 6 39 

-5  75 

0.346 

( 1,380) 

VoiC9d 

- 5 26 

-4  91 

0.151 

( 1,  188) 

Unvoicod 

- 7 53 

-6  58 

0 301 

(1,  188) 

COMPACTNESS  (Avg  ) 

- 3 43 

-3  02 

0 29  1 

( 1.380) 

VoiC9d 

- 2.48 

- 1 98 

0 583 

(1,  188) 

Un¥0ie9d 

- 4 38 

-5  66 

1 529 

(1,  188) 

0 782 

Accept  Ho  No  difference  in  regression  slopes 

Table  13.  Comparison  of  linear  regression  slopes 

derived  from  individual  intelligibility  feature 
scores,  for  LPC-10  and  PLPC. 
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7.0.  DISCUSSION  OF  FINDINGS. 


Tables  of  intelligibility  scores  for  the  various  features, 
cumulative  plots  of  the  distributions  of  scores,  and  scatter 
diagrams  shown  in  relation  to  linear  regression  lines  are  presented 
in  the  Appendices.  Some  of  the  salient  findings  from  analysis 
of  this  data  are  presented  in  the  following  paragraphs. 

The  Lilliefors  test,  described  in  Appendix  I. 2.,  indicated  that 
the  hypothesis  of  a normal  distribution  of  scores  should  be 
rejected  for  a majority  of  the  data  groupings  of  intelligibility 
scores  for  individual  intelligibility  features.  Deviation  from  a 
normal  distribution  appeared  to  derive  from  three  primary  causes, 
singly  or  in  combination:  (1)  truncation  of  the  range  of  scores 
at  100%;  (2)  significant  differences  among  mean  scores  for 
individual  speakers;  and  (3)  significant  differences  among  mean 
scores  for  the  feature  states,  e.g.  the  Voicing  scores  included 
Voicing  Present  (frictional  and  non-f ric tional)  and  Voicing  Absent 
(frictional  and  non-f rictional) , etc.  Total  intelligibility  scores, 
representing  the  summation  of  these  effects,  were  better  approximations 
to  normal  curves,  as  reported  in  earlier  sections  of  this  report. 

Even  with  these  departures  from  the  assumptions  underlying  the 
linear  regression  model,  the  expected  feature  scores  predicted  by 
the  regression  models  for  the  features  on  the  whole  agreed  well 
with  the  actual  data;  these  comparisons  are  presented  in  Appendix  G.5. 

The  distributions  of  intelligibility  scores  were  also  characterized 
by  a tendency  to  show  a significant  negative  correlation  between 
mean  scores  and  variance  associated  with  the  distributions  (as  has 
been  found  generally  in  intelligibility  testing).  In  many  cases, 
the  assumption  of  homogeneity  of  variance  required  for  the  linear 
regression  model  tests  of  significance  was  not  fulfilled  in  the  data. 

A result  of  these  distortions  (relative  to  the  model)  was  a tendency 
for  the  confidence  limits  predicted  by  the  model  to  be  conservative 
at  zero  bit  error  rate:  most  or  all  of  the  data  values  were  above 
the  lower  95%  confidence  limit  for  individual  scores.  However,  at 
the  upper  end  of  the  range  (5%  bit  error  rate)  the  model  was  overly 
optimistic:  a larger  percentage  of  datum  points  were  below  the 
confidence  limit  than  predicted  by  the  model.  The  overall  scores  for 
LPC-10  illustrate  this  trend:  at  zero  bit  error  rate,  all  of  the  scores 
were  above  the  lower  95%  limit  estimated  by  the  model.  At  the 
57o  bit  error  rate,  almost  10%  of  the  datum  points  were  outside  the 
95%  limits  estimated  for  individual  points,  an  equal  number  of  points 
occurring  above  and  below  the  limits.  Total  intelligibility  scores 
including  all  bit  error  rates  showed  a remarkable  "global**  agreement 
with  the  model,  however,  in  that  19  out  of  384  points  (4.9%)  were 
distributed  outside  the  95%  limits  for  individual  datum  points 
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estimated  by  the  regression  models,  with  each  processor's  scores 
(LPC  and  PLPC) . 

These  departures  from  the  assumptions  that  underly  the  linear 
regression  model  must  be  kept  in  mind  in  interpreting  the  various 
results  of  significance  tests  on  the  linear  regression  data, 
in  particular  the  estimates  for  957o  confidence  limits  for  slopes 
of  the  regression  lines,  and  95%  confidence  limits  that  have  been 
estimated  for  predicting  distributions  of  individual  scores  at 
different  bit  error  rates.  Lacking  for  the  present  any  data  base 
or  alternative  method  for  estimating  these  limits  with  greater 
reliability,  these  data  are  presented  in  order  to  provide  estimates 
for  the  values, 

7,1,  Comparison  of  LPC  and  PLPC  processor  algorithms. 

There  were  no  special  provisions  in  the  LPC  and  PLPC  processor 
algorithms  involved  in  these  tests  that  were  specifically  designed 
to  alleviate  the  effects  of  bit  errors:  provisions  such  as  optimum 
placement  of  bits  in  the  data  frame,  smoothing  of  the  parameters 
prior  to  speech  synthesis,  error  detection  and  correction,  etc, 
techniques  known  to  be  of  value  in  minimizing  effects  of  bit  errors 
on  speech  intelligibility  and  quality.  The  purpose  here  was  to 
assess  and  compare  the  intrinsic  vulnerability  of  the  LPC  and  PLPC 
speech  processing  algorithms  to  bit  errors,  and  to  perform  a 
definitive  test  of  the  hypothesis  that  the  inherent  redundancy  and 
improved  spectral  modeling  provided  by  the  PLPC  approach  improve 
the  intelligibility  of  the  speech  signals  from  a PLPC-based  processor 
design,  in  comparison  with  a conventional  LPC  design,  with  and  without 
bit  error  effects. 

The  test  results  provided  clear  confirmation  of  this  hypothesis. 
Although  the  numerical  value  of  the  difference  in  performance  was 
in  most  cases  small,  its  statistical  significance  was  confirmed  in 
numerous  tests. 

Error  detection  and  correction,  and  other  special  coding  schemes  to 
reduce  effects  of  bit  errors  can  of  course  improve  the  performance 
of  a conventional  LPC  processor  terminal  in  comparison  with  these 
results  for  which  no  such  provisions  were  present.  However,  these 
test  results  suggest  that  the  application  of  these  schemes  to  the 
PLPC  algorithm  should  in  every  case  provide  more  beneficial  results 
in  improving  speech  intelligibility  and  quality  than  when  applied  to 
the  LPC  algorithm,  other  things  being  equal.  This  conclusion  stems 
from  the  basic  advantages  of  the  piecewise  linear  predictive  coding 
method  that  have  been  previously  cited:  better  spectral  modeling 
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derived  from  the  piecewise  approach,  and  segregation  of  bit 
error  effects  involving  LPC  coefficients  to  only  a portion  of 
the  output  speech  spectrum,  rather  than  the  entire  spectrum  as 
happens  with  conventional  LPC, 

As  a further  consideration,  the  PLPC  algorithm  used  in  these  tests 
was  not  an  optimum  d esign.  There  is  considerable  evidence  that 
changes  in  the  combination  of  frequency  bands  and  the  coding  of  the 
coefficients  could  lead  to  a further  increment  of  improvement  in 
the  performance  attained  in  connection  with  the  PLPC  algorithm: 
refinements  that  are  possible  with  the  PLPC  configuration  because 
of  the  additional  degree  of  freedom  provided  with  the  use  of  multiple 
frequency  bands.  These  changes  would  be  minor  in  terms  of  hardware 
and  software,  but  have  a high  probability  of  leading  to  significant 
results  in  improving  the  performance  in  both  the  error-free  condition 
and  in  the  presence  of  bit  errors.  Similar  considerations  are 
involved  in  connection  with  the  acoustic  noise  problem:  the  separation 
of  the  speech  signal  into  frequency  bands  affords  an  additional 
degree  of  flexibility  in  refinement  of  the  algorithm  to  combat 
effects  of  acoustic  noise. 

Some  details  of  the  contrasts  in  intelligibility  scores  for  the 
various  intelligibility  features  are  described  in  the  following 
paragraphs . 

A comparison  of  the  data  distributions  of  intelligibility  scores 
for  Voicing  Present  in  comparison  with  Voicing  Absent  obtained  with 
the  LPC  processor  revealed  that  the  difference  in  susceptibility  to 
bit  errors  (as  estimated  by  the  regression  slopes)  was  significant 
only  for  the  non- frictional  sounds,  involving  voiced  and  unvoiced 
initial  stop  consonants.  Here  the  regression  slope  was  -8.12 
for  Voicing  Present,  and  -3.1A  for  Voicing  Absent.  Although  in 
this  case  the  unvoiced  sounds  were  not  as  susceptible  to  bit  errors 
as  the  voiced  sounds,  the  reverse  was  true  in  the  case  of  the 
voiced  and  unvoiced  states  associated  with  the  features  Graveness 
and  Compactness , as  will  be  described  in  the  discussion  of  those 
features.  The  test  words  and  intelligibility  data  for  the  Voicing 
feature  are  presented  in  Appendix  A;  a complete  table  of  regression 
equations  relating  intelligibility  scores  with  bit  error  rate 
for  the  various  intelligibility  feature  states  is  presented  in 
Appendix  G. 

In  the  case  of  intelligibility  scores  for  the  PLPC  processor,  the 
difference  in  regression  slopes  for  Voicing  Present  vs.  Voicing  Absent 
was  significant  for  both  the  frictional  case  (a  = .05)  and  the 
non-f rictional  case  ( a = .001). 
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Intelligibility  scores  for  the  Nasality  feature,  listed  in 
Appendix  B,  indicated  that  neither  the  contrast  between 
Nasality  Present  and  Nasality  Absent,  or  the  contrast  between 
Nasality (Grave)  and  Nasality (Acute)  evidenced  significant 
differences  in  values  of  the  regression  slope  in  the  case  of 
performance  data  for  the  LPC  processor.  However,  the  distributions 
of  scores  for  the  PLPC  processor  showed  a significant  difference 
between  the  regression  slopes  for  Nasality  Present  ( b = -2.58) 
and  Nasality  Absent  ( b = -4.73)  at  the  level  a = .01. 

The  test  words  and  intelligibility  scores  for  the  Sustention 
feature  are  listed  in  Appendix  C.  Scores  obtained  with  the 
LPC  processor  indicated  that  the  regression  slope  for 
Sustention (Vo iced)  scores  with  b = -7.19  was  significantly 
greater  than  that  for  Sustention (Unvoiced)  with  b = -4.21,  at 
the  level  a = .05.  However,  this  contrast  was  not  significant 
in  the  case  of  intelligibility  scores  for  the  PLPC  processor. 

The  contrast  between  regression  slopes  for  Sustention  Present 
and  Sustention  Absent  intelligibility  scores  was  not  significant 
for  either  the  LPC  processor  or  the  PLPC  processor,  suggesting 
that  on  the  average  the  sustained  and  the  abrupt  consonants 
were  equally  vulnerable  to  the  effects  of  bit  errors. 

Data  for  the  Sibilation  feature  scores  are  presented  in 
Appendix  D.  These  distributions  indicated  that  no  significant 
difference  in  susceptibility  to  bit  errors  was  present  for  the 
contrast  between  this  feature  being  present  and  absent , or  for 
the  contrast  between  the  voiced  and  unvoiced  states  of  Sibilation, 
with  either  LPC  or  PLPC  intelligibility  scores. 

Details  of  Graveness  intelligibility  scores  are  shown  in  Appendix  E. 
The  data  analysis  indicated  that  there  was  no  significant  difference 
in  susceptibility  to  bit  errors  for  the  feature  Graveness  Present 
contrasted  with  Graveness  Absent,  for  either  the  LPC  or  the  PLPC 
processor  scores.  However,  the  LPC  processor  scores  revealed  a 
significant  difference  in  regression  slopes  for  Graveness (Voiced) 
with  b = -5.26,  in  comparison  with  Graveness (Unvoiced)  with 
b = -7.53,  at  the  level  a = .05.  This  contrast  was  not  significant 
in  the  case  of  the  distributions  of  scores  for  the  PLPC  processor; 
however,  a similar  bias  was  observed,  i.e.  the  unvoiced  state 
Graveness  displayed  a greater  susceptibility  to  bit  errors 
than  the  voiced  state. 
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The  distributions  of  intelligibility  scores  and  other  data 
for  the  Compactness  intelligibility  feature  are  presented  in 
Appendix  F.  These  scores  showed  a pattern  similar  to  that 
obtained  with  the  scores  for  Graveness , in  that  the  unvoiced 
state  of  the  feature  exhibited  a greater  vulnerability  to 
bit  errors  than  the  voiced  state,  in  the  case  of  scores  for 
both  the  LPC  and  the  PLPC  processors.  However,  as  with  the 
Graveness  feature,  the  contrast  was  significant  for  the 
LPC  processor  scores  (a  = ,05)  but  not  significant  for  the 
PLPC  processor.  The  contrast  between  Compactness  Present 
and  Compactness  Absent  regression  slopes  was  not  significant 
for  either  processor. 
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7.2.  Implications  for  Digital  Voice  Terminal  Hardware 
Development. 

The  magnitude  of  improvement  in  speech  intelligibility 
obtained  by  using  the  piecewise  linear  predictive  coding 
method  in  preference  to  conventional  LPC  is  sufficiently  small 
that  it  would  be  difficult  to  justify  choosing  PLPC  hardware  and 
software  for  a voice  terminal  design  if  there  were  premium 
hardware  costs  incurred  by  using  PLPC  rather  than  LPC.  However, 
the  nature  of  the  PLPC  algorithm  is  such  that  a voice  terminal 
based  on  this  approach  could  reasonably  be  expected  to  cost  less , 
not  more,  than  an  LPC  design.  The  basis  for  this  conclusion 
is  that  the  PLPC  algorithm  operates  at  half  the  sample  rate  of 
LPC,  for  performing  the  speech  analysis  and  synthesis  functions. 

The  PLPC  algorithm  also  requires  less  computation:  fewer 
multiplications  and  fewer  additions,  than  conventional  LPC 
(this  is  assuming  that  the  filtering  operations  at  the  input 
and  output  are  done  with  hardware  filters  or  with  CCD,  rather  than 
by  digital  filtering  operations).  Inevitably  these  factors  should 
cause  a PLPC-based  voice  terminal  to  be  cheaper  and/or  more 
cost  effective  than  an  LPC-based  design.  For  example,  the  reduced 
computational  load  would  free  up  computational  capacity  in  the 
processor  to  be  available  for  modem  functions,  signalling  and 
supervision,  error  correction  and  detection,  acoustic  noise 
reduction  algorithms,  etc. 

These  advantages  would  carry  over  to  a wideband  version  of  PLPC 
operating  at  8.0  or  9.6  Kbps,  with  a residual  (error)  signal 
representing  the  difference  between  the  linear  predictive  model 
and  the  actual  speech  signal  measured  and  encoded  for  transmission 
along  with  the  narrowband  data.  In  this  context  the  reduced  sample 
rate  made  possible  by  the  piecewise-LPC  configuration  would  reduce 
the  computational  load  involved  in  calculating  residuals,  as  well 
as  permitting  more  data  bits  to  be  assigned  in  encoding  the  residuals 
in  comparison  with  alternative  methods.  Thus  a multiple  rate  processor 
(MRP)  voice  terminal  design  based  on  PLPC  can  be  expected  to  offer 
performance  advantages  as  well  as  computational  advantages  in 
comparison  with  other  approaches. 

With  regard  to  vulnerability  to  bit  errors,  a variety  of  coding 
refinements  are  possible  that  can  alleviate  this  problem,  ranging 
from  simple  rearrangement  of  the  bit  pattern  per  data  frame,  to 
sophisticated  error  detection  and  correction  schemes.  These  tests 
were  made  without  any  refinements  of  this  nature.  However,  they 
indicate  that  coding  refinements  to  reduce  susceptibility  to  bit 
errors  should  always  provide  greater  benefit  for  the  PLPC  algorithm 
than  they  can  provide  with  conventional  LPC,  because  of  the  intrinsic 
advantages  that  are  possessed  by  the  PLPC  technique:  more  accurate 
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modeling  of  the  speech  signal,  and  inherent  redundancy  provided 
by  the  PLPC  technique. 

7.3.  Implications  for  Intelligibility  Test  and  Evaluation 
Procedures  and  Standards. 

The  regression  slopes  calculated  for  different  speaker*s 
intelligibility  scores  showed  significant  differences  among 
the  speakers,  suggesting  that  there  are  innate  differences  in 
individual  speaker*s  susceptibilities  to  bit  error  effects. 

The  trend  tended  to  follow  the  relative  intelligibility  rank 
possessed  by  individual  speaker*s  intelligibility  scores  under 
ideal  conditions  (no  bit  errors),  suggesting  that  some  speakers 
speech  signals  have  intrinsic  properties  causing  them  to  be 
more  susceptible  to  signal  degradation  in  general,  whether  caused 
by  effects  of  bit  errors  on  the  data  signals,  or  by  a reduced 
number  of  data  coefficients,  etc.  This  question  deserves  further 
study,  since  a better  understanding  of  the  causes  of  speaker 
variability  might  lead  to  improvements  in  the  voice  processing 
algorithms  to  meet  the  goal  of  obtaining  fully  adequate  performance 
with  a large  and  varied  population  of  speakers. 

Since  the  values  of  the  independent  variable  (bit  error  rate) 
were  equal  in  each  speaker  test,  the  overall  regression  equations 
(all  speakers)  involved  values  of  the  slope  and  elevation 
that  were  the  average  values  of  the  slopes  and  elevations 
respectively,  of  individual  speakers.  The  reasons  for  this  are 
discussed  in  Appendix  I.l. 

The  analysis  of  variance  findings  showed  that  highly  significant 
differences  among  intelligibility  scores  for  individual  speakers 
were  present,  as  well  as  significant  interactions  between 
speakers  and  processors,  as  well  as  speakers  and  bit  error  rates. 
Conspicuous  evidence  of  these  interactions  is  revealed  in 
comparing  the  regression  lines  derived  from  the  LPC  and  the  PLPC 
performance  data  with  speakers  LL  and  PK,  for  example  (Figs.  5 
and  9). 

The  degree  of  speaker  variability  and  speaker/processor  interactions 
suggests  that  inadequate  attention  has  been  given  to  this  topic. 
While  these  effects  have  been  commonplace  in  speech  testing  over 
the  past  several  years,  they  have  received  little  attention,  in 
part  because  of  the  practice  of  calculating  standard  errors  from 
listener  mean  scores  only. 
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The  economics  of  speech  testing  would  rule  against  routine 
testing  with  a large  number  of  speakers.  However,  if  the 
purpose  of  test  and  evaluation  is  to  guide  critical  decisions 
in  comparing  the  performance  of  alternative  processors, 
to  evaluate  the  significance  of  improvements  in  the  speech 
processing  algorithms,  or  to  predict  the  performance  that  can 
be  expected  with  a large  and  varied  population  of  speakers, 
it  is  likely  that  the  present  practice  of  testing  with  six 
(male)  speakers  is  marginal,  and  that  a reevaluation  should 
be  made  as  to  an  appropriate  number  and  types  of  speakers  to 
be  used  in  speech  testing  in  order  to  fully  meet  these  objectives. 

For  the  near-term,  it  would  seem  desirable  to  double  the  number 
of  speakers  as  a minimum,  where  critical  tests  are  required. 

With  twelve  speakers,  the  idiosyncrasies  of  individual  speakers 
would  tend  to  be  averaged  out  in  the  data  population, 
a result  particularly  valuable  in  regard  to  the  data  for  the 
individual  intelligibility  features.  Since  it  is  in  these 
fine  details  that  the  significance  differences  between  different 
processors  are  found,  the  proposed  change  should  be  of  considerable 
value  not  only  for  comparing  processors,  but  for  clearly 
identifying  the  intelligibility  features  that  are  most  deficient 
and  where  refinements  could  bring  the  greatest  benefits. 

With  regard  to  further  testing  in  order  to  assess  effects  of 
bit  errors  on  speech  intelligibility,  tests  with  processors  that 
incorporate  special  coding  provisions  to  reduce  vulnerability 
to  bit  errors  should  include  test  conditions  at  10%  and  20% 
bit  error  rates  in  addition  to  those  reported  here.  Tests  at 
these  six  rates  would  result  in  a mean  bit  error  rate  of  6.5% 
(compared  with  2.25%  in  these  tests).  The  confidence  limits 
associated  with  regression  models  have  the  property  of 
widening  above  and  below  the  mean  value  (see  Appendix  I.l); 
the  additional  rates  would  give  the  tightest  confidence  limits 
for  predicting  scores  in  the  range  from  about  5%  to  8%  bit  error 
rate . 

It  would  be  desirable  to  conduct  further  tests  of  bit  error 
conditions  with  two  replications  of  each  processing  condition 
(Note:  replications  of  processing,  as  opposed  to  replication 
of  the  presentation  to  listeners).  Such  a procedure  would  permit 
a better  assessment  of  variations  caused  by  the  algorithm  or 
process  used  to  generate  the  bit  errors. 
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8.0  CONCLUSIONS  AND  RECOMMENDATIONS. 


Formal  tests  and  evaluations  were  conducted  to  compare  the 
susceptibility  of  narrowband  linear  predictive  coding  (LPC) 
for  voice  processing,  and  the  more  recent  innovation  of 
piecewise  linear  predictive  coding  (PLPC)  to  the  effects  of 
bit  errors,  both  processor  configurations  operating  at  a 
2400  bit-per-second  data  rate.  Test  results  confirmed  an 
hypothesis  that  piecewise  LPC  voice  processors  are  less 
susceptible  to  bit  errors  than  conventional  LPC. 

Significant  differences  were  found  in  the  susceptibilities 
of  individual  speakers  and  individual  intelligibility  features 
to  the  effects  of  bit  errors. 

Linear  regression  models  were  utilized  in  constructing  tables 
predicting  intelligibility  performance,  and  approximate 
confidence  limits  for  the  predictions,  over  a range  of  bit 
error  rates.  These  tables  include  interpolation  and 
extrapolation  for  estimating  intelligibility  performance  that 
might  be  obtained  under  specified  bit  error  conditions. 

The  findings  suggest  that  the  piecewise  version  of  linear 
predictive  coding  for  narrowband  digital  voice  communications 
offers  a superior  alternative  to  conventional  linear  predictive 
coding  (LPC),  since  these  benefits  are  obtained  simultaneously 
with  a relaxation  of  hardware  implementation  requirements  for 
speed  and  number  of  computations. 

The  piecewise  linear  predictive  coding  (PLPC)  processor  was 
shown  to  consistently  give  better  intelligibility  than  LPC, 
both  under  **ideal"  conditions  and  under  bit  error  conditions. 

Further  improvement  in  the  piecewise-LPC  voice  processor  performance 
is  foreseen  with  minor  refinements  of  the  frequency  band 
arrangement,  and  the  parameter  coding  tables  used  in  PLPC. 

These  benefits  are  foreseen  to  carry  over  to  a medium  bandwidth 
configuration  of  piecewise-LPC  operating  at  8.0  or  9.6  kilobits 
per  second,  adding  a residual  signal  for  improved  speech  quality 
and  naturalness  and  tolerance  to  acoustic  noise  environments. 

It  is  recommended  that  the  research  and  development  on  piecewise 
linear  predictive  coding  be  accelerated  to  completion  of  the 
optimization  of  performance  of  the  narrowband  version,  and 


to  include  investigations  and  implementation  of  a feasibility 
model  operating  at  8,0  and  9.6  kilobits  per  second  in  addition 
to  the  narrowband  configuration.  The  investigation  should 
also  address  the  feasibility  of  embedding  the  2400  bit-per-second 
data  stream  in  the  data  stream  at  the  higher  data  rates. 
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DRT  test  words  for  Voicing. 


Reference:  Comparison  of  LPC  and  PLPC  I n te I I I g I b I I i ty  Scores  at  2400  BPS  with  bit  errors: 
intelligibility  Scores  for  VOI C I NG, 
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Data  Table:  Voicing  Intelligibility  Scores  for  LPC  and  PLPC. 
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THREE-WAY  ANALYSIS  OF  VARIANCE  (m  OBS.  PER  CELL) 
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ORT  INTELLIGIBILITY  SCORE  FOR  VOICING  . 
LPC“  10  AT  2400  BPS 


A. 4.!.  Cumulative  distributions  of  the  intelligibility  scores 
for  the  Voicing  feature.  LPC-IO  at  2400  BPS. 


I0th-0rd#r  PLPC(6/4)  AT  2400  BPS 


A. 4. 2.  Cumulative  distributions  of  the  intelligibility  scores 
for  the  Voicing  feature,  PLPC  at  2400  BPS. 


A9 


A.5J.  Scatter  plot  of  scores,  and  linear  regression  model 
for  the  Voicing  intelligibility  feature,  obtained  with 
LPC-IO  at  2400  BPS,  Regression  lines  for  Voicinq-Present, 
and  Volcing-Absent . are  also  shown. 


AS  A FUNCTION  OF  BIT  ERROR  RATE 

A. 5. 2.  Scatter  plot  of  scores,  and  linear  regression 
Model  for  the  Voicing  intelligibility  feature, 
obtained  with  PLPC  at  2400  BPS. 
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Intelligibility 

of  VOICING  vs 

Bit  Error  Rote . for 

2400  BPS  LPC- 

Model : 

S(LPC)*  94.97- 

5.020  (BERT.)  (Bosed 

on  192  points) 
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95V#  Confidence  Limits 

Error 

Rote 

of 

VOICING 
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Individupl  Scores 
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64  8 J 

\ 59.15  -70  55 

28  38  -101 .32 

7 

® Extropolattd  52  89  -66.76 

23.  15  - 96.51 
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54.8  Valuts  46.60-63.02 

17.87  - 91  75 

9 

49  8 

40  29-59.29 

12  54  - 87  04 

I07« 

44  8 

33  96  -55  58 

7.17  - 82.37 

A.  6.  I.  Predicted  intelligibility  scores  for  Voicing  , 
LPC-IO  at  2400  BPS  with  bit  errors  (with  no 
provisions  for  error  protection). 


Intelligibility 

of  Votcina 

Bit  Error  Rote  . for 

2400  BPS  PLPC 

Model : 

S(PLPC)*  96.32- 

3 625(BERV#)  (Based 

on  192  points) 
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Intelligibility 
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Error 
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63  7 

56  45  70  94 

35  28  - 92.12 

lOV# 

60  1 

51.83  •*  68.32 

31.38  - 88  76 

A. 6. 2.  Predicted  inteliigibility  scores  for  Void ng. 
PLPC  at  2400  BPS  with  bit  errors  (with  no 
provisions  for  error  protection). 
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INTELLIGIBILITY  FEATURE!  NASALITY 
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DRT  test  words  for  Nasality. 
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Data  Table:  N a s a 11  ty  Intelligibility  Scores  for  LPC  and  PLPC. 
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-continued  (part  2). 
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B.  2.  -continued  (part  3) 
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.3.2.  Analysis  of  Variance  Summary:  Nasality  Present. 
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DRT  intelligibility  SCORE  FOR  NASALITY. 
LPC-IO  AT  2400  BPS 


B.4.I.  Cumulative  distributions  of  the  intelligibility  scores 
for  the  Nasality  feature,  LPC-10  at  2400  BPS. 


I0th-0rd«r  PLPC  (6/4)  AT  2400  BPS 


B.4.2.  Cumulative  distributions  of  the  Intelligibility  scores 
for  the  Nasal  ity  feature,  PLPC  at  2400  BPS. 
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AS  A FUNCTION  OF  BIT  ERROR  RATE 


B.5.I.  Scatter  plot  of  scores,  and  linear  regression  model 
for  the  Nasality  intelligibility  feature,  obtained  with 
LPC-IO  at  2400  BPS. 


NASALITY  IMTELLIGI8ILITY  OF  2400  8PS  PLPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 


B.S.2.  Scatter  plot  of  scores,  and  linear  regression  model 
for  the  Nasality  intelligibility  feature,  obtained  with 
PLPC  at  2400  BPS.  Regression  lines  for  Nasallty-Present 
and  Nasality-Absent,  are  also  shown. 
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Intelligibility  of  NASALITY  ^ 8it  Error  Rote,  for  2400  BPS  LPC-IO 
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B.6.1.  Predicted  Intelligibility  scores  for  Nasality,  LPC-IO 
at  2400  BPS  with  bit  errors  (with  no  provisions  for 
error  protection). 


Intelhgibtlity  of  Naiohly  ^ Bit  E r ror  Rote . for  2400  BPS  PLPC 
Model:  S(PLPC)  * 98  31  - 3 654(8ER7o)  (Bosedon  l92  points) 
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B.6.2.  Predicted  intelligibility  scores  for  Nasality,  PLPC 
at  2400  BPS  with  bit  errors  (with  no  provisions 
for  error  protection). 
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INTELLIGIBILITY  FEATURE!  SUSTENTION 
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three-way  analysis  or  variance  (m  CRS.  rrK  (.lld 
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Data  Table:  S ustention  Intelligibility  Scores  for  LP  C and  PLPC. 
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-continued  (part  2) 
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-continued  (part  3). 
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.3.3.  Analysis  of  Variance  Summary:  Sustention  (Unvoiced). 


0 20  40  60  BO  100 

ORT  INTELLIGIBILITY  SCORE  FOR  SUSTENTION  . 


LPC  - 10  AT  2400  BPS 


C.4.1.  Cumulative  distributions  of  the  intelligibility  scores 
for  the  Sustention  feature,  LPC-IO  at  2400  BPS. 


DRT  INTELLIGIBILITY  SCORE  FOR  SUSTENTION . 
I0th‘0rd«r  PLPC(6/4)  AT  2400  BPS 

C.4.2.  Cumulative  distributions  of  the  intelligibility  scores 
for  the  Sustentio  n feature,  PLPC  at  2400  BPS. 
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SUSTENTION  INTELLIGIBILITY  OF  2400  BPS  LPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 

C.5.I.  Scatter  plot  of  scores,  and  linear  regression  model 
for  the  Su stention  intelligibility  feature,  obtained 
with  LPC-IO  at  2400  BPS.  Regression  lines  for  the 
Voiced  and  Unvoiced  conditions  are  also  shown. 


C.5.2.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  Sustention  Intelligibility  feature,  obtained  with 
PLPC  at  2400  BPS.  Regression  lines  for  the  Voiced 
and  Unvoiced  conditions  are  also  shown. 


70 


Intelligibility 
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6 1 0 

57  15  -64.75 

21  .83-100.07 

5 

55  3 

50  34  -60  16 

16.01  — 94  49 

6 

50  0 \ 

r 43  39—55.72 

10  1 3—  88  97 

7 

43  9 EMtrapalattd  36  35  •♦51. 35 
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8 
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- 1 78-^^  78  08 
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32  5 

22  1 8— 42  72 

- 7 81  — 7 2.71 

107« 

26  7 

15  07-38  43 

-13  90—  67  40 

C.6.1.  Predicted  intelligibility  scores  for  Sustention.  LPC-IO 
at  2400  BPS  with  bit  errors  (with  no  provisions  for 
error  protection). 


Intelligibility  of  Susfenfion  Bit  Error  Rote  . for  2400  BPS  PLPC 

Model;  S(PLPC)  * 84.08  - 4.9l2(BER7o)  (Based  on  192  points) 
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Sustention 
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0 
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5 4 6 1 
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4 9.7  Extrapotated  42.45  — 56.94 

1 1 .39  - 

88.0  1 
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4 4.8  Voiues 

36.22  ^ 53.36 
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29.95  - 49.80 
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107. 
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23.68  - 46  25 

- 4.31  ^ 

74.24 

C.6.2.  Predicted  intelligibility  scores  for  Sustention.  PLPC 
at  2400  BPS  with  bit  errors  (with  no  provisions  for 
error  protection!. 
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D.2.  Data  Table:  Sibilation  Intelligibility  Scores  for  LP  C and  PLPC. 
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D.  2.  -cbntin uell  (part  2) 
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D.  2.  -contin ued  (part  3) 
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0 20  40  60  80  100 

DRT  INTELLIGIBILITY  SCORE  FOR  SIBILATION  . 
LPC-IO  AT  2400  0PS 


D.4.I.  Cumulative  distributions  of  the  inte! i igibiiity  scores 
for  the  Sibiiation  feature,  LPC-iO  at  2400  BPS. 


DRT  INTELLIGIBILITY  SCORE  FOR  SIBILATION . 
I0th-0rd*r  PLPC(6/4)  AT  2400  BPS 


D.4.2.  Cumuiative  Distributions  of  the  Inteiilglbility  scores 
for  the  Sibiiation  feature.  PLPC  at  2400  BPS. 
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SIBILATION  INTELLIGIBILITY  OF  2400  BPS  LPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 

D.5.1.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  Sibilation  intelligibility  feature,  obtained  with 
LPC‘10  at  2400  BPS.  Regression  lines  for 
Sibilation-Present  and  Sibilation-Absent  are  also  shown. 


SIBILATION  INTELLIGIBILITY  OF  2400  BPS  PLPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 

D.5.2.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  Sibilation  Intelligibility  feature,  obtained  with 
PLPC  at  2400  BPS.  Regression  lines  for 
Sibilation-Present  and  Slbllation-Absent  are  also  shown. 
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Infelhgibility  of  Sibilotion  Bit  Error  Rote . for  2400  BPS  LPC-IO 


Model:  S ( LPC)  « 68.33  - 2 .446( BER%)  (Boted  on  192  points) 


Bit 

Inlelligibility 

95%  Confidence  Limits 

Error 

of 

Rote 

Sibilotion 

Exp§ct9d  Avg.  Score 

Individuol  Scores 

0 

88.3 

85.04  — 91  62 

58  .58  — 118  06 

1 

85.9 

83.34  — 88.43 

56  .21  —1  15.56 

2 

83.4 

8 1 .29-  85  59 

53  80—1  13.08 

3 

81.0 

78.70-83  28 

51  .34  —1  10.64 

4 

78  5 

75.66  — 81  .43 

48  84  —108  25 

5 

76.1 

72.37  — 79.83 

46.30  — 105.90 

6 

73.7  i 

68  97— 78  33 

43  72  —10359 

7 

71.2  Extrapolot§d  65  51  ■^76.90 

41.10  — 101.31 

6 

68.8  Valu9t 

62.02—75.50 

38  44—  99.08 

9 

66.3 

58  52— 74  1 1 

35.74  — 96.89 

10% 

63  9 

55.00—72.74 

33  00—  94.73 

D.6.I.  Predicted  Intelligibility  scores  for  Sibil ation . 
LPC-IO  at  2400  BPS  with  bit  errors  (with  no 
provisions  for  error  protection). 


Intelligibility  of  Sibilotion  « Bit  Error  Rote  , for  2400  BPS  PLPC 


Model : 

S(PLPC)  ■ 95.58- 

3 351  (BER%)  (Based 

on  192  points) 

Bit 

Intelligibility 

95  7.  Confidence  Limits 

Error 

Rote 

of 

Sibilation 

Expected  Avg  Score 

Individuol  Scores 

0 

95.6 

93  35  - 97.80 

75. 48  - 1 15.67 

1 

92.  2 

90.50  - 93.94 

72.  17-  1 12  27 

2 

66.9 

87.42  - 90.33 

68.84-  108  90 

3 

65.5 

83  97  - 87.07 

65.49-  105.56 

4 

62.  2 

80  22  - 84.12 

62.  1 0 - 102.24 

5 

7 8.6 

76.30  - 8 1 .34 

58.68  - 96.95 

6 

7 5.  5 T 

72.30  - 78.63 

55.24  - 95.69 

7 

72.1  Extrapalat§d  68.27  - 75.96 

51 .77  - 92.46 

6 

66.6  Vo/4iet  64  2 { -73.32 

48.28  - 89.25 

9 

65  4 

60.14  - 70.68 

44  75  - 8607 

107. 

62.  1 

56.07  - 68.06 

41.21  - 82.92 

D.6.2.  Predicted  i ntelilgibii ity  scores  for  Sibilation. 
PLPC  at  2400  BPS  with  bit  errors  (with  no 
provisions  for  error  protection). 
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INTELLIGIBILITY  FEATURE!  GRA  VENESS 
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INTELLIGIBILITY  FEATURE.  GRAVENESS  (JL.) 
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E.  I.  (part  2)  DRT  test  words  for  Graveness  grouped  to  permit  scoring 
Graveness(Stopped)  vs.  Graven  ess  (Un  stopped).  (This  scoring  option  was 
not  utilized  in  this  battery  of  tests). 


Scores  for  GRAVENESS 


CL 

CO 


o 

o 


^ ♦- 


CJ 

q: 

LJ 

CL 


CO 

o 


L) 

z 

< 

cc 


u 

CL 


o 

oc 


CL 

CD 


o 

o 


Qr«.OCNCNir\r'OoOr«.r>* 

QOOO'OvOr'.COOmOCOrO 

oou^oo— ir\r«*0'0a' 
-^r^ir\^\0'Or«.r«.coo^ir\ 


CNlfXOfNOOr^CNOCSlCMCN 

or«*0'Oir\o»o  — u>vo*vo 


»0\Oir^'^'Or«*ir\ir\co^ir\^ 


CN 

a. 

2 

jp^iTior^iTkor^oor^oo 

or^r^oouMr\r»r»or^O 

LJ 

p^r«»o®r«*ifMX)Oo®Oo 

ococDOJor^r^ooH^ip^coo 

♦- 

CN 

> 

• ••••••••••• 

(0 

n 

< 

TJ 

prj'^O'OfOr-.'OOO'OOO 

0'0'00r«*40r0v0'*<‘r^v00 

X 

QC 

0 

Q^O'OO'O'COO'OOO'OO 

OO'O'OCOO'O'O'CpooO'O 

L) 

O 

o 

CL 

l/> 

—1 

l/> 

0 

CL 

LJ 

> 

2 

T3 

N 

UJ 

C 

«o 

> 

to 

< 

QC 

o 

O 

CL 

n 

—1 

(A 

■O 

o 

o 

t— 

0 

4- 

2 

o 

p^irjr'Or^o^'ic^u^CMCMr^ 

CMCMO^*r>  CMOCMt^CM^C^r^ 

Ul 

(0 

in 

UJ 

— 

^CMCOO'^OCOCMCM'O'OrO 

vOMir\'Or»«OvO'^»CM'^ 

O 

QC 

0 

lO 

0 

• ••••••••••• 

T3 

LJ 

> 

-3.— — — \o»r»0’«t 

moocMU>oooooir\0'K>— ^ 

O 

r-} 

L 

10 

QC 

c 

J]^oor^r«»oor«*r*«*GOir\'00oo 

\or*«vO'0\or*«ir\\oir\ir\ooao 

(A 

o 

1- 

Q. 

3 

L 

L 

m 

L 

O 

L 

CO 

o 

LJ 

L 

CO 

• 

(/) 

10 

3 

LJ 

O 

in 

Q> 

4- 

o 

2 

L~\ 

• 

O 

Q. 

— 

U_ 

LJ 

o 

u 

CO 

CO 

LJ 

> 

CM 

o 

LJ 

LJ 

< 

0 

1- 

DC 

CM 

CL 

•• 

Z 

o 

■o 

4- 

«« 

LJ 

0 

in 

(A 

s 

O 

0 

4- 

•• 

— 

in 

— 

h- 

QOirxr^r^r^ifxcMoic^fNo 

(A 

r«*OOlOCMUMr\CMOCMOO 

0 

^ir\r'cooocor-'0o^'0o 

0 

K>oif'C^“fNCM'Oir\  — 00 

(A 

Z 

(A 

> 

« 

h- 

• ••••••••••• 

0) 

z 

C 

0 

r«*40\o  'O'OfO  00  »^oo 

^ir\r*K>co  — \ou>r«*ooOQ. 

z 

U 

o 

4- 

qqCOO'O'O'O'O'O'O  O'On  0 

» 

oor^coo'r^®u>vo®r^oo 

z 

•— 

0 

0 

< 

w 

4- 

♦ 

L 

4- 

z 

(A 

(0 

in 

CO 

0 

C 

in 

o 

s 

Q. 

L 

L 

E 

— 

•— 

o 

CO 

O 

(A 

3 

— 

L 

L 

L 

— 

> 

Q. 

o 

L 

0 

O 

0 

0 

0 

>- 

o 

0 

^ X X ^ UJ  > 

L 

J X X LJ  > 

L 

o 

L 

ja 

_l  X 0 CL  -»  £D 

L 

-1  X U X -»  X 

CM 

4- 

0 

(A 

L L L L L 

L L L..  L L L 

-o 

-o 

o 

•0 

0 

4- 

i3 

0 0 0 0 0 0 

4- 

0 0 0 0 0 0 

3 

(0 

JiC  JC  ^ ^ 

^ ^ JC 

• 

• 

• 

• 

— 

0 

0 0 0 0 0 0 

0 0 0 0 0 0 

L 

L 

L 

L 

0 

u 

L 

0 0 0 0 0 0 

0 0 0 0 0 0 

2 

2 

2 

2 

> 

CL 

0 

Q.  Q.  Q.  0.  a.  0. 

Q.  Q.  Q.  Q.  Q.  Q. 

— i 

NJ 

lO  l/>  lO  lO  lO  lO 

— 

CO  CO  CO  CO  CO  CO 

-84- 


E.  2.  Data  Fable:  Graveness  Intelligibility  Scores  for  LPC  and  PLPC. 
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E,  2.  -contin ued  (part  2). 
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E.  2.  -continued  (part  3) 


THREE-WAY  ANALYSIS  OF  VARIANCE  (m  OGS . PER  CELL) 
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ORT  INTELLIGIBILITY  SCORE  FOR  GRAVENESS. 
LPC  - 10  AT  2400  BPS 


E.4.I.  Cumulative  distributions  of  the  intelligibility  scores 
for  the  Graven  ess  feature,  LPC-IO  at  2400  BPS. 


ORT  INTELLIGIBILITY  SCORE  FOR  GRAVENESS. 
I0th*0rd«r  PLPC(6/4)  AT  2400  BPS 


E.4.2.  Cumulative  distributions  of  the  intelligibility  scores 
for  the  Graveness  feature,  PLPC  at  2400  BPS. 
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AS  A FUNCTION  OF  8IT  ERROR  RATE 

E.5.1.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  Graveness  intelligibility  feature,  obtained  with 
LPC-10  at  2400  BPS.  Regression  lines  for  the 
Voiced  and  Unvoiced  conditions  are  also  shown. 


igibdit  y 

of  Graveness  vs 

Bit  E rro  r Rote  , for 

2400 

BPS 

PLPC 

Model ; 

S(PLPC)*  85.31  - 

5.746(BER7«)  (Bosed 

on  192  points) 

Bit 

1 ntelligibility 

95  7®  Confidence  Limits 

Error 

of 

Rote 

Gro veness 

Expected  Avg  Score 

Individual 

Scores 

0 

B5.3 

80  60  - 90  0 1 
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I0  7o 
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1 5 14  -40  56 

- 1 6 

38  - 

72.07 

E.6.2.  Predicted  intelligibility  scores  for  Graveness . PLPC 
at  2400  BPS  with  bit  errors  (with  no  provisions 
for  error  protection). 
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Intelligibility 

of  Groveness 

vs.  Bit  Error  Rote . for 

2400  BPS  LPC-I 

Model: 

S(LPC)  » 03. 

,10  - 6.394(BER%)  (Bosed 

on  192  points) 
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25.6 

15  14—35  97 

-15  27—  66  38 

10% 

1 9 2 

7.32— 31  00 

-22  05  — 60.37 

E.  6. 1.  Predicted  intelligibility  scores  for  Graveness . LPC-IO 
at  2400  BPS  with  bit  errors  (with  no  provisions  for 
error  protection). 


AS  A FUNCTION  OF  8lT  ERROR  RATE 

E.5.2.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  Graveness  Intelligibility  feature,  obtained  with 
PLPC  at  2400  BPS.  Regressitn  lines  for  the 
Voiced  and  Unvoiced  conditions  are  also  shown. 
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INTELLIGIBILITY  FEATURE:  COMPACTNESS 
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F.l.{part  2)  DRT  test  words  for  Compactness  grouped  to  permit  scoring 
Compactness(Sustained)  vs.  Compactnessd  nterrupted).  (This  scoring 
option  was  not  utilized  in  this  battery  of  tests). 
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F.l.  (part  3)  DRT  test  words  for  Compactness  grouped  to  permit  scoring 
Compactness(Back  vs.  Middle)  vs.  Co  mpactn  ess  (Back  vs.  Front).  (This 
scoring  option  was  not  utilized  in  this  battery  of  tests). 


Reference:  Comparison  of  LPC  and  PLPC  Intelligibility  Scores  at  2400  BPS  with  bit  errors: 
intelligibility  Scores  for  COMPACTNESS » 
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Data  Table:  Compactness  Intelligibility  Scores  for  LPC  and  PLPC. 
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F.  2.  -contin ued  (part  2). 


COMPACTNESS  PRESENT  COMPACTNESS  ABSENT 
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F.  2,  -continued  (part  3) 
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DRT  INTELLieiBiLITt  SCORE  FOR  COMPACTNESS. 


LPC-IO  AT  2400  BPS 


F.4.I.  Cumulative  distributions  of  the  Intelligibility  scores 
for  the  Compactness  feature.  LPC-IO  at  2400  BPS. 
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DRT  INTELLIGIBILITY  SCORE  FOR  COMPACTNESS. 


lOtk-Ordtr  PLPC(6/4)  AT  2400  BPS 


F.4.2.  Cumulative  distributions  of  the  intelligibility  scores 
for  the  Compactness  feature,  PLPC  at  2400  BPS. 
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COMPACTNESS  intelligibility  OF  2400  BPS  LPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 


F.5.I.  Scatter  plot  of  scores,  and  linear  regression  model 
for  the  Compactness  Intelligibility  feature,  obtained 
with  LPC-IO  at  2400  BPS.  Regression  lines  for  the 
Voiced  and  Unvoiced  conditions  are  also  shown. 
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COMPACTfiESS  INTELLIGIBILITY  OF  2400  BPS  PLPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 


F.5.2.  Scatter  plot  of  scores,  and  linear  regression  model 
for  the  Compactness  intelligibility  feature,  obtained 
with  PLPC  at  2400  BPS.  Regression  lines  for  the 
Voiced  and  Unvoiced  conditions  are  also  shown. 
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Inlelligibillty  of  Compactness  ys.  Bit  Error  Rott . for  2400  BPS  LPC-IO 
Modtl;  S(LPC)*  95.19  - 3 432(8ER%)  (Bosed  on  192  points) 


Bit 

Intelligibility 

95%  Confidence  Limits 

Error 

Rote 

of 

Compactness 

Expected  Avg.  Score 

Individual  Scores 

0 

95  2 

92  38 

— 98.00 

69  73-120  64 

1 

9 1 .8 

89.58 

-93  93 

66  36-117  15 

2 

88.3 

86.48 

-90.16 

62.96  - 113  69 

3 

84.9 

82.93 

- 86.85 

59.  52  -no  27 

4 

8 1.5 

78.99 

- 83.93 

56.04  -106.88 

5 

78.0 

74  84 

-81.22 

52.53  -103.53 

6 

74.6  \ 

70.59 

- 78  60 

48.98  -100.21 

7 

71  2 Extrapolated  66,29 

- 76.04 

45.40  - 96  93 

8 

67  7 Values 

6 1.97 

- 73  50 

4 1 78  - 9 3.68 

9 

64.3 

57  63 

- 7097 

38.  14  - 90  46 

10% 

60  9 

53.28 

-68.46 

34.45  - 87  28 

F.6.i.  Predicted  intelligibility  scores  for  Compactness, 

LPC-IO  at  2400  BPS  with  bit  errors  (with  no  provisions 
for  error  protection). 


Inttlligibiliiy  of  Compactness  Bit  Error  Rbtg . for  2400  BPS  PLPC 
Modtl:  S(PLPC)  > 95J3- 3.619  (eER%)  (Bostdon  192  points) 


Bit 

1 ntel  ligibihty 

95%  Confidence  Limits 

Error 

of 

Expected  Ava  Score 

Individual  Scores 

Rote 

Compactness 

0 

95.1 

92  .02 

- 98.24 

67. 00  -123  26 

1 

9 1 .3 

88.90 

- 93  72 

63.25  -119  37 

2 

B7  5 

85.46 

- 89  53 

59.46  -115.52 

3 

B3.  7 

81.5  1 

- 85  84 

55  63  -n  171 

4 

79.9 

77  12 

- 82  58 

5 1 .76  —107  94 

5 

76.0 

72.51 

- 79  56 

47.86  -104.21 

6 

72  2 1 

67.79 

- 76  64 

43.91  -100.52 

7 

BB  4 Extrapolated  63.01 

- 73  78 

39  93  - 96B6 

B 

64.6  Values 

58  2 1 

- 70.95 

35  90  — 93.25 

9 

60  B 

53.38 

- 68.13 

3 1 .85  - 89  67 

lOV. 

56.9 

48  55 

- 65  33 

27.75  - 86.12 

F.6.2.  Predicted  Intelligibility  scores  for  Compactness. 

PLPC  at  2400  BPS  with  bit  errors  (with  no  provisions 
for  error  protection). 
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LINEAR  REGRESSION  ESTIMATES  OF  INTELLIGIBILITY  BIT  ERROR  RATE 

LPC-IO  AT  2400  BITS  PER  SECONO 

FORM'  ORT  INTELLIGIBILITY  SCORE  - o b R , wh«r«  R>  B.E.R  in  p«rc«nt 

INTELLIGIBILITY  FEATURE  FEATURE  FEATURE 

FEATURE  PRESENT  ABSENT  AVERAGE 


VOICING  (Avg) 

9 3.7 

- 

9.70  R 

96  .2  • 

4.34  R 

95  0 

- 

5.0  2 R 

frieltaaal 

9 7 5 

- 

3 28  R 

93  8 - 

9 53R 

90  5 

- 

4.4  1 R 

Nan  - frtelianal 

10  0.0 

8 12  R 

99  7 - 

3.  1 4R 

9 9.  4 

- 

5 63  R 

nasality  (Avg  1 

99.2 

- 

5.79  R 

98  0 - 

3.69  R 

9 8.6 

- 

5 7 5 R 

Grata 

9 7.  1 

- 

4.48  R 

97.9  “ 

5.54R 

97  4 

- 

4 0 i R 

A eyta 

10  1 .3 

3.08  R 

99  2 - 

5.95R 

99  8 

- 

3 46R 

SUSTCNTION  (Atg  ) 

96.8 

- 

6.79  R 

90.7  - 

4.6  1 R 

8 3.8 

- 

5 70  R 

VaicaG 

86  2 

- 

8 29  R 

75  5 - 

6.09R 

79  7 

- 

7.  19  R 

Un  talc  a a 

9 7.4 

- 

5.29  R 

88.2  - 

3.1  3R 

87  8 

- 

4. 21  R 

SIBILATION  (Atg) 

82  1 

3.32  R 

94.6  - 

1 .57R 

8 8 3 

- 

2 45  R 

Vaiead 

8 1 8 

- 

2.S0R 

95.5  - 

2.09R 

8 8.6 

- 

2. 30  R 

Uitraiead 

82.4 

- 

4 1 4 R 

93.6  - 

I.05R 

8 8.0 

- 

2.  60R 

GHAVCNeSS  (Avg) 

82.8 

_ 

6 05  R 

95  5 - 

6 .74R 

8 3.1 

_ 

6 39R 

Vaiead 

92.6 

- 

6 06  R 

97  2 - 

4 46R 

9 4.9 

- 

5 26R 

Uitfalead 

72  9 

- 

6 04  R 

69.  7 - 

9 02R 

7 t . 5 

- 

7. 93  R 

CONPACTNCSS  lAtg  ) 

97.5 

- 

5 07  R 

93  1 - 

3.79R 

95 . 2 

- 

5 45  R 

vaiead 

99.6 

- 

2.  19  R 

99.9  - 

2 76R 

99.8 

- 

2.48  R 

untatead 

95.0 

- 

3 96R 

86  2 - 

4 80R 

90.6 

- 

4 38  R 

TOTAL  DRT  INTELLIGIBILITY  SCORE:  90.7  - 4 49  R 


G.i.  Summary  of  linear  regression  equations  relating 

intelligibility  scores  and  bit  error  rate,  for  individual 
Intelllgiblilty  feature  states;  LPC-IO  at  2400  BPS. 

LINEAR  REGRESSION  ESTIMATES  OF  INTELLIGIBILITY  vi  BIT  ERROR  RATE 
lOth-Ordar  PI  ECE  WISE  > L PC  (6/4)  AT  2400  BITS  PER  SECONO 
Form:  ORT  INTELLIGIBILITY  SCORE  - o f bR,  whora  R-  B E R in  porcant 

INTELLIGIBILITY  FEATURE  FEATURE  FEATURE 

FEATURE  PRESENT  ABSENT  AVERAGE 


VOICING  lAtg.) 

9 5.6  - 

1.71  R 

97  0- 

5.94R 

96.3 

- 

3 63  R 

frietianal 

9 3 1- 

1 94  r'*’ 

94  3 - 

5 23R 

9 3.7 

- 

3 58  R 

Nan  • frietianal 

98.1- 

1 48  R 

99.8  - 

5.65R 

98  9 

■ 

3.67  R 

nasality  (Avg  ) 

98  8 - 

2 58  R 

97  8 - 

4.73R 

96  3 

_ 

3.  65  R 

Grava 

9 7.3  - 

2.29  R 

97  6- 

4.6SR 

97  4 

- 

3.  57  R 

Aeula 

100.  5 - 

2 66  R 

98.1- 

4 .6  1 R 

99.  2 

- 

3 74  R 

SUSTENTION  (Atg  } 

6 3 1- 

4.56  R 

8 5 1- 

5.26R 

64.  1 

- 

4.  9 1 R 

Vaiead 

8 0.2  - 

3.63R 

77  2 - 

5.08R 

78.  7 

- 

4.  45  R 

Un  vaiead 

85  9 - 

5 30R 

95.0- 

5.44R 

69.  5 

- 

5 37  R 

SIBILATION  (Avg  ) 

94.8  - 

4 52  R 

96  5 - 

2 16  R 

95  6 

- 

3.35  R 

Vaiead 

95  3 - 

2 91  R 

95  7- 

2.31  R 

94.5 

- 

2.61  R 

Unvaiead 

94  3 - 

6 1 3 R 

99  0- 

2.  05R 

9 6.6 

- 

4 09  R 

GBAVENESS  (Avg  ) 

64  6 - 

6 75R 

66  0 - 

4 76R 

65.3 

_ 

5 .75  R 

Vaiead 

9 7.  9 - 

7.58  R 

9 6.5  - 

2 4SR 

97  2 

- 

4 9 1 R 

Unvaiead 

7 1.4- 

6.08  R 

7 5.5- 

7.  08R 

75  4 

- 

6 56  R 

COMPACTNESS  (Avg  ) 

98  1 - 

4 85  R 

92  ,2  - 

2.  79R 

95.  1 

3 62R 

Vaie  ad 

96.  6 - 

2.  62R 

9 7.6  - 

1.  1 3R 

9 7.1 

- 

I . 96  R 

Unvaiead 

99.  5 - 

6.  88  R 

8 6.8  - 

4 45R 

93.  1 

- 

5 66R 

TOTAL  DRT  INTELLIGIBILITY  SCORE:  92.5  - 4.  I 8 R 

far  ihi*  eata,  tha  valua  at  tha  tiapa  ma$  nat  »i§nitica»t . 


G.2.  Summary  of  linear  regression  equations  relating 

Intelllgiblilty  scores  and  bit  error  rate,  for  individual 
intelligibility  feature  states;  PLPC  at  2400  BPS. 
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EXPECTED  VALUES  AND  f9%  CONFIDENCE  LIMITS 
FOP  BIT-EPROR  REGRESSION  COEFFICIENTS 


LPC-IO  AT  2400  BITS  PER  SECOND 


INTELUGIBILITY 

FEATURE 

FEATURE 

PRESENT 

FEATURE 

ABSENT 

FEATURE 

AVERAGE 

VOICING  (Arg  1 
Friellonol 

Non  - Fricifonol 

-4.  l4<(-9  70)<-3.27 
-6.O2<(-3.20)<-  .54 
- I2.I7<(-8.I2  l<-4.06 

•5. 50  <(-4.34)  <-3. 17 
•7.20  <(-5.53  ) <-5.44 
-4.31  <(-3.14  ) <-  1.94 

-4  37<(-5.02)<-3.47 
-5.99  <(-4.4l)<-2.82 
-7.81  <(-9.65)<-3.49 

NASALITY  (Arg.l 
Groro 

Aeulo 

•5.02  <(-3.70)<-2  54 
-6  50<(-4.40)<-2  .39 
•4.24^-3.O0)<-l  .92 

•4.8  1 <(-3  69  ) <-2.96 
-5.12  <(-3.54  ) <-l  .97 
-5.51  <(-3.83  ) <-2.  15 

•4.54  <(-3.74)<-2.9I 
-5  30  <(-4.01  )<-2.72 
-4  49  <(-3.46)<-2  43 

SUSTSNriON  (Arg  ) 
Voicod 

Unroicod 

-8.76<(-6.79)<-4  82 
- 1 1 26<(-0  30)<-9.32 
-7  e2<(-5.29)<-2.77 

•6.40  <(-4  61  ) <-2.42 
-9.25  <(-6.09)  <-2.93 
-5.17  <(-3  13  ) <-  1 09 

-7.  16  <(-5.70  )<-4.24 
-9  36  <(-7.19  )<-9.02 
-5.84  <(-4.21  )< -2.59 

SIBILATION  (Avg  1 
Volcod 

Untoicod 

-5  04<(-3  32)<-l  60 
-5,  l6<(-2  90)<-  .16 
-6.40<|-4. 14)<-I  .89 

-2  29  <(-  1 .57  ) <-  .85 
*3.10  <(-2.09  ) <-l  .08 
-2.10  <(-  1 05  ) <-.002 

-3  56  <(-2.43  )<-  1.34 
-3.89  <(-230  ) <-  .70 
-4  18  <(-2.60)  <- I.OI 

GRAVENESS  {Avg  } 
VOfCOd 

Unvotcod 

-7.71  <(-6  05)<-4.5e 
-7  84<(-6  06)<-4  29 
-8  00<(-6.04)<-4.07 

-9.24  <(-6.74  ) <-4.24 
-5  91  <(-4.46)  <-301 
-II  49  <(-9  02)  <-6  54 

•7.88  <(-6.39  1 <-491 
-6.47  <(-5.26)  <-4.05 
-9  18  <(-7.53l<-5.87 

COMPACTNESS  (Avg 

Voicod 

Unvoieod 

)-4.08<(-3.0'^)<-2.07 
-3.03<(-2.l9)<-l  34 
-5  99<(-3.94)<-2.38 

-5  36  <(-3.79  ) <-2.2l 
-3.88  <(-2.70  1 < - 1 68 
-7.05  <(-400)  <-2  54 

-4  38  <(-3.43)<-2  48 
-3  17  <(-2  40)  <-  1.80 
-5  04  <1-4  50)  <-2.92 

TOTAL  DRT  INTELLIGIBILITY  SCORE! 

- 4.69<(-4.45)<  - 

4 22 

G.3.  Estimated  confidence  limits  for  regression  slopes: 
LPC-10  at  2400  BPS. 


EXPECTED  VALUES  AND  95%  CONFIDENCE  LIMITS 
FOR  BIT -ERROR  REGRESSION  COEFFICIENTS 
lOth  ORDER  PIECEWISE  - LPC  (6/4)  AT  2400  BITS  PER  SECOND 


INTELLIGIBILITY  FEATURE  FEATURE  FEATURE 

FEATURE  PRESENT  ABSENT  AVERAGE 


VOtCINGfArf)  - 3.00  <|- I .7 1 ) < - .42 

Friefi^nml  -4  16^1-1  •4)^  .20**^ 

Non  - FfietiMtol  -2.7S<(-  l.4«)<>  .22 

W4S4L/7y  I4»i  } -3.52  <( -2 .50  )<  • I .«4 

Grovo  -5.40  <(-2.29)<-  .*9 

Aeoto  -4.24  <(-2.0€  )<-l  47 

SUSTFNTtON  M»f  .J  - 6.76  <( -4.54  I < -2  34 
Voi<oA  -4  44  <(-545  )<-  .74 

UnroicoA  -4.40  <(-5.30  )<-2. 00 

SIBILATION  (Aw§.)  -5  44  <(-4.52  )<-3  34 
VoieoA  -4  14  <(-2.91  )<- I 43 

UntoieoA  - 7 72  << -4  13  )£- 4.55 

6BAVtN£SS  Mvff.)  -4  90  ^-4.73)<-4  54 
VoitoA  -9  l5<(-7  36)<-54l 

UnwoifA  -9  23  <(-4  04)  <-2.95 

COttPACTNCSS  Mrf  .>-632^-4  45)  <-3.34 
VtifA  -447i(-242)  <-  .77 

UowitoA  -4.79S(-4.44)  <-4.97 


•4  99<(- 

•5  54)<- 

4 09 

-4.44 

<*-3.43)5- 

2.59 

-7  26 

<(< 

-5.25)<- 

3. 19 

-5.13 

5|-3  9i)<- 

2.04 

-7.97 

S(- 

•5  e5)<- 

3.74 

-5  02 

5*-3  47)5- 

2.31 

-6.01 

4.73  )<- 

3.45 

-4.46 

5<-3.*5)5- 

2.43 

-4.74 

<(• 

'4.45  )<- 

2.94 

-4.74 

5<-3  37)5- 

2 34 

-4  44 

<<- 

'4  41  )<- 

2 74 

-4  92 

<1-3.74)5- 

2.54 

-7.09 

■5.24)<- 

3 43 

-4.33 

<1-4.91  )5- 

3.50 

•4.09 

s<- 

-5  04)<' 

■2.04 

-4.57 

<4-444)5• 

>2.34 

-6.95 

<(• 

•5.44)<- 

■3  96 

-7.17 

<(-3.57)5- 

•3.37 

-2  94 

<(• 

-2.14  )<• 

1.38 

-4.10 

5i-3.39)5- 

■2.40 

-3.54 

<(■ 

-2.51  )<• 

■1.06 

-5.46 

5*-2  41)5- 

•1  .74 

-2  93 

<( 

-2/>5)<- 

-1.  17 

-5.32 

5*-4.ot)5- 

•2.47 

-7.04 

<( 

-4.74)<' 

•2  44 

-7.34 

5*-5.73)5- 

•4  15 

-3.81 

^( 

-2.45)<' 

-1.06 

-4.22 

<*-4.91  )< 

-3.40 

-9.92 

-7.04)S« 

•4A4 

-8.65 

5(-464)5- 

•4.50 

-4.29 

Si 

-2.79)^ 

- 1.24 

•467 

5t- 362)5 

-2.77 

-2.00 

Si 

-1.13)5- 

• .24 

-3.10 

5*- 1 96)5 

- .45 

-4  52 

Si 

-4.49)<- 

•2.36 

•7.11 

5*-566)5 

-4.21 

TOTAL  OPT  INT£LU6iBlUTr  SCORf/  - 4. 42  5 (- 4.  18)  5 “ 3.99 
^■^For  §in^l9  cot*.  fhA  95X  conMika  infArvml  *if4*Xop0i  ACCEPT 


G.4.  Estimated  confidence  limits  for  regression  slopes: 
PLPC  at  2400  BPS. 
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NTELLICI81LITY  FEATURE  SCORES!  LPC-IO  AT  2400  BPS 


Componng  Expected  Scortc  Rtgffiow  Modtl  ofid  octuot  doto  volute 


FEATURE 

Zero  B E.R 

1% 

3% 

5%  8 E.R. 

Predicted 

Actuol 

Predicted 

Actuol 

Predicted 

Actuol 

Predicted 

Actuol 

VOICING 

95  0 

94  5 

B9  9 

90  1 

79  9 

809 

69  9 

69  3 

NASALITY 

9B  6 

97  0 

94  9 

95  5 

B7  4 

900 

79  9 

78  2 

SUSTENTION 

B3  B 

B6  5 

7B.I 

76  6 

66  7 

62  8 

55  3 

57  9 

SIBILATION 

BB  3 

BB  6 

B5  9 

65  6 

6 1 0 

79  7 

76  1 

76.4 

GRAVENESS 

B3  1 

63  3 

76  7 

76  7 

63  9 

63  5 

5 II 

51  4 

COMPACTNESS  95  2 

95  7 

91  B 

91  1 

84  9 

64.6 

78  0 

78  2 

G.5,I,  Comparison  of  actual  scores  for  individual  Intelligibility 

features,  and  scores  predicted  by  linear  regression  models; 
LPC-10  at  2400  BPS, 


INTELLIGIBILITY  FEATURE  SCORES  PLPC  AT  2400  BPS 
Componng  Expected  Secret  Regression  Mode!  ond  Actual  Ooto 

FEATURE  ZeroBER  1%  37.  57.BER 


Predicted 

Actuol 

Predicted 

Actuol 

Predicted 

Actual 

Predicted 

Actuot 

Voicing 

96  3 

95  4 

92.7 

93  2 

85  4 

86  6 

78  2 

77.4 

Nasality 

98  3 

97  2 

94  7 

96  1 

87  3 

872 

80  0 

79  8 

Sustention 

64  I 

64  6 

79  2 

79  2 

69  3 

680 

59  5 

60  3 

Sibilation 

95  6 

96  0 

92  2 

9 1 0 

85  5 

870 

78  8 

78  2 

Groveness 

85  3 

86  8 

79  6 

77  7 

68  1 

66  2 

56  6 

56  9 

Compactness 

95  1 

94  3 

91  3 

90  9 

83  7 

865 

76  0 

74  4 

G.5.2.  Comparison  of  actual  scores  for  Individual  Intelligibility 

features,  and  scores  predicted  by  linear  regression  models; 
PLPC  at  2400  BPS, 
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INTELLIGIBILITY  FEATURE  SCORES!  LPC-IO  AT  2400  BPS 
Camparing  Predicfians  fram  Regressian  Madel , and  actual  dato: 

Intelligibility  Scares  exceeded  by  97-l/2V>  gf  the  data  papulatian 


FEATURE 

Zera 

B.E.R 

17. 

37. 

57.  B E.R. 

Predicted 

Actual 

Prediaed 

Actual 

Predicted 

Actual 

Predicted 

Actual 

\^a/C/ng 

5B.7 

62  5 

53  8 

53  i 

43  B 

34.4 

33  6 

-2  1.9 

Nasality 

76.4 

813 

72  7 

7B  1 

65  3 

62  5 

57  7 

40  6 

Susttntion 

44  6 

59  4 

39  0 

34  4 

276 

IBB 

16  0 

1 2 5 

Sibilatian 

5B  6 

46  9 

56  2 

46  9 

5 1 3 

56  3 

463 

2 1 9 

Graveness 

43  4 

46  9 

37  I 

40  6 

24  3 

1 5 6 

1 1 4 

3 1 

Campactness 

69.7 

61  3 

66  4 

59  4 

59  5 

53  1 

5 2.5 

46  9 

G.5.3.  Comparison  of  intelligibility  feature  scores  predicted  by 
confidence  limits,  with  actual  data  distributions; 

LPC-IO  at  2400  BPS. 

INTELLIGIBILITY  FEATURE  SCORES  PLPC  AT  2400  BPS 
Camporing  Predictions  from  Regression  Model,  ond  actuol  doto: 

Intelligibility  Scores  exceeded  by  97-1/2%  of  the  doto  populotion 


FEATURE 

Zero  8.ER. 

17. 

37. 

5 7. 

B.E.R. 

Predicted 

Actual 

Prgtffcfetf  ^tuai 

Predicted  Actijal 

Predicted 

Actual 

VQicir}g 

6B  7 

78.1 

65  1 

6B.B 

57  9 

56  3 

50  5 

2B  1 

Nasality 

76  1 

78  1 

72.5 

B 1.3 

65  2 

53  1 

57  B 

46  9 

Su  stent  lan 

46.2 

34  4 

4 I 4 

40  6 

316 

1 5.6 

216 

1 2.5 

Sibilatian 

75  5 

78.1 

72  2 

75  0 

65  5 

68.8 

5B  7 

34  4 

Graveness 

42  7 

53.1 

37  0 

37  5 

25  6 

9 4 

1 3 9 

- 6 3 

Compactness 

67  0 

6B  B 

63  3 

71  9 

55  6 

62  5 

4 7.9 

2B  1 

G.5.4.  Comparison  of  intelligibility  feature  scores  predicted  by 
confidence  limits,  with  actual  data  distributions; 

PLPC  at  2400  BPS. 
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Reference:  EFFECTS  OF  BIT  ERRORS  ON  TOTAL  ORT  I NTELL I GI P I L ITY  SCORES  FOR  LFC  AIID  PLPC  AT  2400  BPS. 
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Data  Table:  Total  DRT  Intelligibility  Scores  for  LPC  and  PLPC 
at  2400  BPS  with  bit  errors. 
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(FLPC  dt  2400  BPS  - continued) 
12  bit  error  rate.  Test  #2047. 
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-continued  (part  3). 
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H.3.I.  Comparison  of  distributions  of  total  DRT  intelligibility 
scores  of  Speaker  LL;  LPC-IO  and  PLPC  at  2400  BPS. 


H.3.2.  Comparison  of  distributions  of  total  DRT  intelligibility 
scores  of  Speaker  RH:  LPC-IO  and  PLPC.  at  2400  BPS. 
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TOTAL  DRT  INTELLIGIBILITY  SCORE 


H.3.3.  Comparison  of  distributions  of  total  DRT 
scores  of  Speaker  CH:  LPC-IO  and  PLPC, 


intel  ligibi  I ity 
at  2400  BPS. 


TOTAL  DRT  INTELLIGIBILITY  SCORE 


H.3.4.  Comparison  of  distributions  of  total  DRT  intelligibility 
scores  of  Speaker  PK;  LPC-IO  and  PLPC,  at  2400  BPS. 
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H.3.5,  Comparison  of  distributions  of  total  DRT  intelligibility 
scores  of  Speaker  JE.-  LPC-IO  and  PLPC,  at  2400  BPS. 


TOTAL  ORT  INTELLIGIBILITY  SCORE 


H.3.6.  Comparison  of  distributions  of  total  DRT  intelligibility 
scores  of  Speaker  BV.-  LPC-IO  and  PLPC,  at  2400  BPS. 
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100 


AS  A FUNCTION  OF  BIT  ERROR  RATE 

H.4.I.A.  Scatter  plot  of  scores,  and  linear  regression  model  for 
the  total  DRT  Intelligibility  scores  of  Speaker  LL,  with 
LPC-10  at  2400  BPS.  The  6-speaker  regression  line  is  also 
shown. 


DRT  INTELLIGIBILITY  OF  2400  BPS  PLPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 

H.4.I.B.  Scatter  plot  of  scores,  and  linear  regression  model  for 
the  total  DRT  Intelligibility  scores  of  Speaker  LL,  with 
PLPC  at  2400  BPS.  The  6-speaker  regression  line  is  also 
shown. 
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DRT  INTELLIGIBILITY  OF  2400  BPS  LPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 


H.4.2.A.  Scatter  plot  of  scores,  and  linear  regression  model  for 
the  total  DRT  Intelligibility  scores  of  Speaker  RH,  with 
LPC-10  at  2400  BPS. 


AS  A FUNCTION  OF  BIT  ERROR  RATE 

H.4.2.  B.  Scatter  plot  of  scores,  and  linear  regression  model  for 
the  total  DRT  Intelligibility  scores  of  Speaker  RH,  with 
PLPC  at  2400  BPS. 
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INTELLIGIBILITY  OF  2400  BPS  LPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 
95%  Conftd0nee  Bonds  are  shown  for  the  Expected  scare,  and  for  individual  points. 


H.4.3.A.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  total  DRT  intelligibility  scores  of  Speaker  CH, 
obtained  with  LPC-IO  at  2403  BPS. 


AS  A FUNCTION  OF  BIT  ERROR  RATE 
95%  Confidence  Bonds  ore  shown  for  the  Expected  score,  ond  far  individual  points 

H.4.3.  B.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  total  D'^T  intelligibility  scores  of  Speaker  CH, 
obtained  with  pLPC  at  2400  BPS. 
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DRT  INTELLIGIBILITY  OF  2400  BPS  LPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 


H,4.4.A.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  total  DRT  intelligibility  scores  of  Speaker  PK, 
obtained  with  LPC-IO  at  2400  BPS. 


DRT  INTELLIGIBILITY  OF  2400  BPS  PLPC 
AS  A FUNCTION  OF  BIT  ERROR  RATE 

H.  4.  4.  B.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  total  DRT  intelligibility  scores  of  Speaker  PK, 
obtained  with  PLPC  at  2400  BPS. 
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INTELLIGIBILITY  OF  2400  BPS  LPC 

AS  A FUNCTION  OF  BIT  ERROR  RATE 
95%  ConfidsncB  Bonds  ore  shown  for  the  Expoctod  scoro^  ond  for  indivtduol  points 


H.4.5.A.  Scatter  plot  of  scores,  anj  linear  regression  model 
for  the  total  DRT  intelligibility  scores  of  Speaicer  JE, 
obtained  A/Mh  LPC-IO  at  2400  BPS. 


AS  A FUNCTION  OF  BIT  ERROR  RATE 
95%  Conftdsnes  Bonds  or*  shown  for  tho  Expoctod  seoro,  ond  for  individuof  points 

H.4.5.  B.  Siatter  plot  of  scores,  and  linear  regression  model 
for  the  total  DRT  intelligibility  scores  of  Speaker  JE, 
obtained  with  PLPC  at  2400  BPS. 


-120- 


AS  A FUNCTION  OF  BIT  ERROR  RATE 

H.4.  6.A.  Scatter  plot  of  scores,  and  linear  regression  Tiodel 

for  the  total  DRT  intelligibility  scores  of  Speaker  BV, 
obtained  with  LPC-IO  at  2400  BPS. 


AS  A FUNCTION  OF  BIT  ERROR  RATE 

H.4.6.  B.  Scatter  plot  of  scores,  and  linear  regression  model 

for  the  total  DRT  intelligibility  scores  of  Speaker  BV, 
obtained  with  PLPC  at  2400  BPS. 
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APPKNDIX  1.  STATISTICAL  FORMULATIONS. 


1.1.  Linear  regression. 

Given  an  esnemble  of  paired  Tneasurement  data  Xi,  Yi 

) where  the  Xi  are  values  of  an  independent 
variable  (in  this  report,  bit  error  rates  expressed  in 
percentage  points)  and  the  Yi  are  associated  values  of  a 
dependent  variable  (here,  intelligibility  scores  obtained 
at  the  specified  bit  error  rates),  the  n values  of  X and  Y 
can  be  characterized  by  sample  means 

X : I Xi  , Y -j-  I Yi 

n I n I 

estimating  the  '’true"  mean  values  /^x  9 sampled 

populations.  Given  the  mean  values,  the  datum  points  can 
be  expressed  in  terms  of  deviations  from  the  mean  values: 

Xj  - (Xi  - X)  , Yi  s (Yi  - Y) 


and  sums  of  squared  deviations  from  the  means  can  be  calculated 


--  I(X  - X)^ 

= I X^  - (Ix}^/n 


I(Y  - Y)^ 

= X - (lY}^/n 


Sums  of  products  of  deviations  can  also  be  calculated 

Ixy  = I (X  - X )(  Y - ?)  = I XY  - (I  X )(lY}/n 

leading  to  a determination  of  a sample  regression  coefficient 
expressing  values  of  Y expected  per  unit  of  X: 

b --  Ixy/ 


The  sample  regression  equation  estimating  values  of  Y in 
terms  of  X is  expressed 

r = Y ^ bx 

or,  in  terms  of  deviations  from  the  mean, 

y = bx 

In  terms  of  the  original  units, 

Y - yr  b (X  - X) 
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The  sum  of  squared  deviations  of  values  of  the  dependent  variable  V 
from  the  regression  line  can  be  expressed 

leading  to  an  expression  for  the  mean  square  deviation 

Sy.x^  s dy,  / (n  - 2) 

and  an  estimate  of  the  standard  deviation  of  the  regression 
coef  f ic ient 

Sfc  = Sy.x/v^ with  (n-2)  degrees  of  freedom. 

A test  of  significance  of  the  slope  b is  given  by 


t - b / with  (n-2)  degrees  of  freedom. 

The  sample  regression  coefficient  b,  an  estimate  of  the  "true" 
population  regression  slope  j3  can  be  used  in  estimating  a 
confidence  interval  for  the  "true"  regression  slope,  based  on 
the  fact  that 

( b - /3  ) / Sb 

follows  Student *s  t-dis tr ibut ion  with  (n-2)  degrees  of  freedom. 
Consequently  a 957o  confidence  interval  for  the  "true"  regression 
slope  can  be  expressed 


» - -^.05  ^b  ^ ^ ^ b -h  t^s 

Based  on  an  assumption  that  errors  in  estimating  the  elevation  and 
the  slope  of  the  regression  line  are  independent,  their  errors  are 
uncorrelated,  and  the  variance  of  the  sum  of  the  two  errors  is 
the  sum  of  the  two  error  variances.  Consequently 

r cTy  ^ f //n  + ) 

and  the  standard  error  in  estimating  the  expected  value  Y is 

“ ^y.x-^/V/n  +(x^/Xx^) 

with  (n-2)  degrees  of  freedom. 


As  a consequence,  a confidence  interval  can  be  estimated  for  any  y 
estimating  the  "true"  expectation  ; 


interval  for  estimating  indiviaual  valu 


A confidence  interval  /or'  estimating  individual  val^ues  of  y',  given 
values  of  X,  can  also  be  established,  based  on  an  assumption  that 

the  mean  square  error  in  predicting  individual  Y* can  be  expressed 

Sw  tf  2 Q „ ^2 


Sy 


>y.  X 


>y.x‘ 


2x2 


-H  S 


leading  to  a standard  error  for  this 


y - 


X Vl 


I + l/n 


y X 

j2X|siif  tion: 
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The  corresponding  95%  confidence  interval  for  predicting  individual 
datum  points  is 

r - f.o,  sj  s s s'; 

In  comparing  regression  lines  obtained  from  different  sample 


populat 

ions , the 

question 

ar  i 

ses  whether 

the 

regression  lines  can 

be  c 

ons 

idered  to 

be  equivalen 

t,  in  terms 

of 

their 

slopes,  elevations, 

and/ 

or 

residual  variances 

(me 

an  square  devia 

t ions 

from  their 

regress 

ion  lines) 

• 

The 

res 

idual  vari 

ances  of 

two 

regress  ion 

lines  ca 

n be  compared  with 

the 

two 

-tailed  F- 

test,  or 

for 

more  than 

two 

regre 

ssion  lines. 

can 

be 

compared  w 

ith  Bartlett 

’s  test. 

Assuming  homogeneity  of  residuals,  the  slopes  can  be  compared 
by  means  of  the  variance  ratio  of  the  mean  squares:  (Diff.  between 
s lopes )/( "within"  slopes),  in  conjunction  with  the  F-test  with 
1 and  k degrees  of  freedom,  where  k is  the  sum  of  the  d.f.  for 
deviations  from  regression,  for  the  individual  regression  lines. 


The  meansquare  for  "difference  between  slopes"  is  expressed 
MS("dif{")  = li  1 2 (bi  - b2)^  / ( ^ I +■ 
where  X /, X2are  the  values  of  X for  two  regression  lines. 


With  more  than  two  regression  lines, 

- 2 

MS  (di  ff.  between  slopes)  = Hwi  (bj  • b ) 

where  Wj  » I / , b » Iw,  bj  / Iw^ 

(The  sum  of  squares  of  deviations  of  the  b’s  is  a weighted  sum, 
because  the  variances  of  the  namely  Oyjf^^de pend  on  the 

values  of  X ^ 


The  linear  regression  model  assumes  the  existence  of  populations 
of  intelligibility  scores  related  to  specified  bit  error  conditions, 
the  relationship  being  such  that  average  scores  at  each  bit  error 
rate  condition  lie  on  a straight  line,  the  population  regression 
line,  defined 

/X  = a + /3(x  - x)  = a -h  j8x 

where  a and  j8  are  parameters. 

The  parameter  a is  the  mean  score  at  x = 0,  specifying  the 
elevation  of  the  regression  line  when  X = X 

The  value  of  j8  , the  slope  of  the  regression  line,  is  negative  for 
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these  data,  since  an  increase  in  bit  error  rate  caused  a 
decrease  in  intelligibility  scores.  In  this  context,  the 
slope  parameter  b has  the  nature  of  a figure  of  merit  that 
estimates  susceptibility  of  a processor/s peaker/ irte 1 1 igibi 1 i ty 
feature  combination  to  the  effects  of  bit  errors. 

The  linear  regression  equations  for  total  intelligibility  scores 
as  a function  of  bit  error  rate  represented  the  composite  average 
relationship  based  on  intelligibility  scores  of  all  of  the 
speakers,  and  all  of  the  intelligibility  features.  The  data  for 
individual  speakers  involved  identical  numbers  of  sample  points 
at  each  bit  error  rate,  for  each  speaker.  Consequently  the  value 
of  was  identical  in  the  normal  regression  equations  for  each 

speaker’s  scores.  The  result  of  this  identity  was  that  the  values 
of  slope  and  elevation  in  the  regression  equation  for  the  average 
performance  of  all  speakers  were  the  average  values  of  the  slopes 
and  elevations  respectively  of  the  individual  speakers. 

A similar  effect  occurred  in  regard  to  scores  for  individual 
intelligibility  features  (averaged  across  all  speakers).  Here 
also  there  were  identical  values  of  Ex^  in  the  equations  for  each 
intelligibility  feature;  this  identity  resulted  in  the  values  of 
slope  and  elevation  in  the  regression  equation  for  total  intelligibility 
being  the  averages  of  the  slopes  and  elevations  respectively  of 
regression  equations  for  the  individual  feature  scores. 

The  linear  regression  formulation  is  based  on 

Y » a + /9x  + € 

with  values  of  the  dependent  variable  expressed  as  a linear  sum  of 
three  terms,  the  error  term  € representing  a normally  distributed 
random  variable,  independent  of  x,  with  zero  mean  and  standard 
deviation  O'y  ^ . 

For  any  x,  Y provides  an  estimate  of  the  "true”  expectation 
corresponding  to  the  given  x value.  Since 

Y ~ ^ Y ~ a } -h  ( b - /3  ) X 

it  is  seen  that  difference  between  the  estimate  and  the  "true” 
expectation  fjL  has  two  sources,  both  due  to  the  random  term  € : 

a difference  of  elevations,  and  a difference  of  slopes. 

Thus  the  model  is  based  on  assumptions  that  the  variance  or  spread 
of  the  distribution  of  values  of  the  dependent  variable  (here,  the 
intelligibility  scores)  is  the  same  at  every  value  of  the  independent 
variable  (here,  the  bit  error  rate),  and  that  the  distribution  of 
values  of  Y at  each  value  of  x is  normal.  These  assumptions  can  be 
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tested  with  tests  for  homogeneity  of  variance,  and  tests  for 
conformity  with  a normal  curve.  Where  the  data  distributions 
fail  to  conform  with  these  assumptions,  results  of  significance 
tests  are  in  question.  However,  such  results,  taken  in  combination 
with  an  examination  of  the  actual  data  distributions  that  occurred, 
may  provide  insights  as  to  the  nature  and  degree  of  relationship 
between  the  variables  under  examination. 
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1.2.  Lilliefor*s  Test  for  conformity  with  normal  distribution. 

The  Lilliefor*s  test  for  goodness  of  fit  is  a statistic  of  the 
Kolmogorov-Smirnov  type,  in  which  a random  sample  from  some 
unknown  distribution  is  tested  in  order  to  test  the  null  hypothesis 
that  the  unknown  distribution  is  in  fact  a known,  specified 
function,  in  this  case,  normally  distributed. 

The  data  population  consisting  of  a random  sample  Xf  ... 
of  size  n is  used  to  compute  the  sample  mean: 

^ / n 

X = X X/ 

^ / r / 

for  use  as  an  estimate  of  the  ’*true"  mean  fj.  , and  the 
standard  deviation:  / — ^ o 

as  an  estimate  of  the  ’*true"  value  of  a 


Sample  points  are  converted  to  '^normalized"  sample  values 
defined  by  _ 

Z i = ( ^ ) i = 1 , ...  n 

The  test  is  computed  from  the  Zi‘s  rather  than  the  original 
datum  points.  The  normalized  data,  the  Z/'s  defined  above, 
are  used  in  constructing  a cumulative  distribution  function. 

The  normal  cumulative  distribution  is  also  constructed,  based 
on  the  values  of  ^ and  a . The  magnitude  of  the  difference 
between  the  (normalized)  data  distribution  and  the  normal  ogive 
is  calculated  for  each  datum,  to  determine  the  maximum  difference. 
This  difference  is  the  Lilliefor*s  test  statistic,  defined  by 

T2  --  SupIF*(x)-  Six)  I 

The  decision  rule  in  Lilliefor's  test  is  to  reject  Ho  at  the 
approximate  level  of  significance  a if  T2  exceeds  a critical 
value  set  forth  in  Lilliefor's  tables,  which  are  published  in 
Conover  (1971)  (see  Bibliography). 

For  n > 30  , the  critical  value  for  p = .95  is  .886/ 
and  for  p=  .99  is  l.OSl/yX^ 
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1.3.  Bartlett’s  Test  for  homogeneity  of  variance. 

Where  more  than  two  independent  estimates  of  variance  are  to 
be  tested  to  determine  whether  there  are  significant  differences, 
a test  has  been  provided  by  Bartlett,  as  follows. 

If  there  are  g estimates  S/^,  each  with  the  same  number  of 
degrees  of  freedom  f,  the  test  criterion  is 

Mr  Lf(gLogS^-  I Log  Si^  ) 

where  L is  a constant  2,3026  = Ln(lO). 

On  the  null  hypothesis  that  each  is  an  estimate  of  the 

same  a ^ , the  quantity  M/C  is  distributed  approximately 
as  with  (g-1)  degrees  of  freedom,  where 


It  has  been  observed  that  this  test  is  sensitive  to 
non-normality  in  the  data,  particularly  to  kurtosis. 

Data  populations  with  a long  ’’tail”  to  the  distribution, 
i.e.  with  positive  kurtosis,  tend  to  result  in  biased 
results  towards  decisions  of  heterogeneity. 
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1.4.  Comparison  of  two  data  populations  by  paired  samples. 


In  a pairwise  analysis,  the  data  to  be  analyzed  is  converted 
to  a sample  of  n differences  in  measurement  (in  this  case, 
differences  between  intelligibility  scores  taken  pairwise). 

The  members  of  each  pair  have  one  or  more  factors  in  common 
(in  this  analysis  each  pair  were  intelligibility  scores 
from  the  same  speaker,  and  at  the  identical  bit  error  rate). 
Pairing  has  the  effect  of  normalizing  for  average  differences 
(such  as  the  average  differences  between  speaker  means, 
and  between  mean  scores  at  the  various  bit  error  rates) 
that  might  otherwise  tend  to  obscure  differences  between 
the  two  entities  under  comparison  (here,  the  LPC  and  PLPC 
voice  processors) . 

The  analysis  of  paired  data  involves  assumptions  that  differences 
Dj  between  individual  pairs  are  distributed  about  a mean  Md 
which  represents  the  *’true**  average  difference  between  the 
entities  being  compared. 

The  deviations  0/  -yU^are  assumed  to  be  normally  and 
independently  distributed  with  population  mean  zero. 

When  these  assumptions  hold,  the  sample  mean  difference  D 
is  normally  distributed  about  standard  error  CTq 

where  O-D  is  the  standard  deviation  of  the  population  of 
differences . 


The  value  of  (To  is  estimated  from  So 


Sq  / 'x/n 


and 


provides  an  estimate  of  O5  based  on  n-1  degrees  of  freedom. 
As  a result,  the  quantity 


t = ( [5  - /Xq)/  S5 


follows  Student's  t-dis tribution  with  n-1  degrees  of 
freedom,  where  n is  the  number  of  pairs,  thus  permitting 
confidence  limits  to  be  constructed  for  the  mean  difference, 
and  tests  of  the  null  hypothesis  (that  the  mean  difference 
is  zero). 


0 - fa,y  Sg  < D + Sg 
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Commander,  Operational  Test  and  Evaluation  Force 
Norfolk,  VA  23511 

ATTN:  Code  64  (1  cy) 

Redstone  Scientific  Information  Center 
US  Army  Missile  Command 
Redstone  Arsenal,  AL  35809 
ATTnT  Chief,  Documents 
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2500  Colorado  Ave 
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PO  Box  92960 
Worldway  Postal  Center 
Los  Angeles,  CA  90009 

Hq  TAC 

Langley  AFB,  VA  23665 
AITN:  DRC  (1  cy) 
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ATTN:  DRAV  (1  cy) 
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Bedford,  MA  01730 
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ATTN:  Mr.  John  Roberts,  D8  (Jr^cys) 
TRI-TAC  Program  Office  ^ 

Ft  Monmouth,  NJ  07703 

ATTN:  Mr.  L.  Diedrichsen,  Code  TT-E-S 

Institute  for  Defense  Analysis, 
Communications  Research  Division 
Thauet  Rd 

Princeton,  NJ  08540 

ATTN:  Dr.  Thomas  Crystal 

ESD/XR  (Dr.  Donald  Brick) 

Hanscom  AFB,  MA  01731 

Bell  Telephone  Laboratories 

600  Mountain  Avenue 

Murray  Hill,  New  Jersey  07974 

ATTN:  Dr.  James  L.  Flanagan  (1  cy) 
ATTN:  Dr.  David  J.  Goodman  (1  cy) 

Bolt,  Beranek  and  Newman  , Inc . 
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ATTN:  Dr.  John  Makhoul 

Dynastat,  Inc. 

2704  Rio  Grande 
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530  East  Swedesford  Rd. 

Wayne,  Pennsylvania  19087 

ATTN:  Mr.  Charles  Teacher 
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P.O.Box  37 
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ATTN:  Mr.  L.E.Cassel 
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ATTN:  Dr.  Thomas  P.  Barnwell 
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Salt  Lake  City,  Utah  84112 

ATTN:  Dr.  Steven  F.  Boll 

Speech  Communications  Research  Laboratory 
800A  Miramonte  Drive 
Santa  Barbara,  California  93109 
ATTN:  Dr.  John  D.  Markel 

Electrical  Engineering  Department 
North  Carolina  State  University 
Raleigh,  NC  27607 

ATTN:  Dr.  J.B. O'Neal,  Jr. 

Research  Laboratory  of  Electronics 
Massachusetts  Institute  of  Technology 
Cambridge,  Mass.  02139 

ATTN:  Dr.  Dennis  Klatt 

GTE  SYL VANIA,  Inc. 

Electronic  Systems  Group 
77  "A"  Street 

Needham,  Mass.  02194 

ATTN:  Dr.  Aaron  J.  Goldberg 

Joint  Speech  Research  Unit 

Eastcote  Road 
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ITT,  Inc. 
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492  River  Road 

Nutley,  New  Jersey  07110 

ATTN;  Dr.  Marvin  A.  Epstein 

TRW,  Inc. 

Systems  Group 
One  Space  Park 

Redondo  Beach,  California  90278 
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RCA 

Defense  Electronic  Products 
Front  and  Cooper  Streets 
Camden,  New  Jersey  08102 
ATTN:  Willard  Meeker 
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P.O.Box  6118 
Garland,  Texas  75041 
ATTN:  D.  Fulghum 

Texas  Instruments,  Inc. 

Central  Research  Laboratory 
P.O.Box  6015  MS  208 
Dallas,  Texas  75222 

ATTN:  Dr.  Richard  Wiggins  (2  cys) 

Haskins  Laboratories 
270  Crown  Street 
New  Haven,  Conn.  06511 

ATTN:  Dr.  Franklin  S.  Cooper 
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